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(57) A playback apparatus not only plays back an 
AV stream recorded on a BD-ROM but also downloads 
an update kit from a WWW server (500) and writes it on 
a local HD (12). The AV stream stored in the local HD 
(12) includes an audio stream for an additional lan- 
guage. A control unit (16) reads the AV stream recorded 



on the BD-ROM and the AV stream recorded in the local 
HD (12) in units of access units. An audio decoder (6) 
obtains a necessary audio frame from the access units 
read from the BD-ROM and the local HD (12) and plays 
it back. A video decoder (4) obtains video data from the 
access unit read from the BD-ROM and plays it back. 
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Description 
Technical Field 

[0001] The present invention relates to playback ap- 5 
paratuses for playing back video data recorded on an 
optical disc such as a Blu-Ray Disc Read Only Memory 
(BD-ROM) and to optical discs, and also relates to a 
technique for playing back movie productions and the 
like distributed on optical discs. 

Background Art 

[0002] When movie productions are to be distributed, 
a great difficulty is posed by language differences. In 
order to set aside time for producing audio dubbing and 
subtitles, the movie industry has adopted a business 
method by which optical discs are distributed in the U. 
S.A. first, and distribution timing of optical discs in non- 
English regions is staggered, for example for Western 
Europe and Japan, and for Eastern Europe and other 
Asian countries. (This business method is called "time- 
shift".) With the use of this time-shift method, movie pro- 
ductions are distributed to each of different regions in 
the world, with English audio and/or subtitles and the 
audio and/or subtitles in the native language of the re- 
gion. It should be noted the Patent Document 1 men- 
tioned below discloses an example of the prior art relat- 
ed to techniques for playing back audio and playing back 
sub-images on DVDs. 

[0003] There are users, not so large in number but 
definitely in any country and region, who desire to own 
an optical disc in a version that is not distributed in his/ 
her own country or region . A typical example is that there 
are some users who purchase a translated version of 
an optical disc in their second language besides English 
and their native language in order to learn the second 
language. In most cases, however, the places where 
such discs on which a movie production is recorded in 
a second language are sold are limited to the areas 
where the language is spoken, and it is difficult for most 
users to purchase such a disc in his/her own country. In 
addition, even if a user orders such a disc from the area 
where the language is spoken, the user may not be able 
to ptay back the disc on the playback apparatus he/she 
owns, due to the region code restriction, 
[0004] The second languages users wish to learn are, 
for example, Japanese, German, French, Chinese, 
Russian, and there is a wide range in variation of lan- 
guages for different users. It is a large burden on dis- 
tributors to keep the lineup of products so as to cover 
all different languages. It is also an extremely high mar- 
keting risk for distributors to bring products in only cer- 
tain languages into markets. Using discs for learning 
languages is a mere example, and there are some users 
in any country for sure who wish to have a disc in a ver- 
sion that is not distributed in their own country. Conven- 
tionally, there is no technique that makes it possible for 



distributors to meet such demand of the users. 

Patent Document 1 

Japanese Patent No. 2,821,030 

Disclosure of the Invention 

[0005] An object of the present invention is to provide 
a playback apparatus that is able to satisfy a user who 
wishes to have a disc in a version that is not distributed 
in his/her own country. 

[0006] The object is achieved by a playback appara- 
tus for an optical disc on which a first digital stream is 
recorded, the playback apparatus comprising: a first 
reading unit operable to read the first digital stream, part 
by part, from the optical disc; a control unit operable to 
specify, from a secondary recording medium, a second 
digital stream that is in correspondence with the first dig- 
ital stream; a second reading unit operable to read the 
specified second digital stream, part by part, from the 
secondary recording medium, in accordance with con- 
trol by the control unit; and a playback unit operable to 
play back, in synchronization, data included in a part 
read from the optical disc and data included in a part 
read from the secondary recording medium. 
[0007] With this arrangement, on an assumption that 
the second digital stream is a version for a second lan- 
guage besides a native language, the second digital 
stream is read from the secondary recording medium, 
part by part. In parallel, the first digital stream recorded 
on the optical disc is read, part by part. By taking out 
necessary pieces of data from a part read from the sec- 
ondary recording medium and from a part read from the 
optical disc and having the playback unit play back the 
pieces of data in synchronization with each other, it is 
possible to play back the main body of the first digital 
stream while it is accompanied by playback of audio or 
a subtitle in the second language version. It is possible 
to establish a new form of business in which such an 
additional second digital stream is sold via the Internet 
so that update kits in a second language version are sold 
by a small quantity to users in the world who wish to 
have the second language for the purposes of learning 
the language. When such a form of business is estab- 
lished, it can be a new source of profits with movie pro- 
ductions. 

[0008] It is acceptable to have an arrangement where- 
in the playback unit includes: a first demultiplexer oper- 
able to demultiplex the part of the first digital stream to 
obtain pieces of video data and pieces of first audio data ; 
a second demultiplexer operable to demultiplex the part 
of the second digital stream to obtain pieces of second 
audio data; a video decoder operable to decode video 
data; an audio decoder; and a supplying subunit oper- 
able to supply either the pieces of first audio data or the 
pieces of second audio data to the audio decoder, 
wherein the playback unit achieves the playback in syn- 
chronization by, in a case where the pieces of second 



15 



20 



25 



30 



35 



40 



45 



50 



2 



3 



EP 1 553 769 A1 



4 



audio data are supplied to the audio decoder, synchro- 
nizing the decoding of each piece of second audio data 
by the audio decoder with the decoding of each piece 
of video data by the video decoder 
[0009] With this arrangement, on an assumption that 5 
the second digital stream is a version for a second lan- 
guage besides a native language, it is possible to play 
back the audio data included in the second digital 
stream in synchronization with the video data included 
in the first digital stream. Since it is possible to practice 
listening comprehension in the second language while 
viewing the moving picture of a movie production, lean- 
ing efficiency of the second language will be enhanced. 
By using this learning efficiency as a selling point, dis- 
tributors will be able to make large profits by selling the 
second digital stream as update kits to users in the world 
who wish to learn the second language. 
[001 0] It is acceptable to have an arrangement where- 
in the part of the first digital stream and the part of the 
second digital stream are each a packet sequence, the 
first demultiplexer performs the demultiplexing at a time 
indicated by a time stamp on each packet, and the sec- 
ond demultiplexer performs the demultiplexing at a time 
obtained by adding a predetermined offset to a time in- 
dicated by a time stamp on each packet. 
[0011] With this arrangement, since the two digital 
streams are synchronized with each other at a stage of 
being demultiplexed, even if the reading of one digital 
stream from the optical disc is not performed in parallel 
with the reading of the other digital stream from the sec- 
ondary recording medium, it is possible to supply pieces 
of data to the audio decoder while keeping them in syn- 
chronization. 

[0012] In addition, even if master clocks referred to 
during the encoding process are different from each oth- 
er, it is possible to supply pieces of data to the audio 
decoder while keeping them in synchronization. 
[001 3] It is acceptable to have an arrangement where- 
in the part of the first digital stream and the part of the 
second digital stream are each a packet sequence, the 
video decoder decodes each of the pieces of video data 
included in the first digital stream at a time indicated by 
a time stamp on a packet in which the respective piece 
of video data is included, and the audio decoder de- 
codes each of the pieces of second audio data included 
in the second digital stream at a time obtained by adding 
a predetermined offset to a time indicated by a time 
stamp on a packet in which the respective piece of sec- 
ond audio data is included. 

[0014] With this arrangement, since the two digital 
streams are synchronized with each other at a stage of 
being decoded, even if the reading of one digital stream 
from the optical disc is not performed exactly in parallel 
with the reading of the other digital stream from the sec- 
ondary recording medium, the audio decoder is able to 
decode the audio in synchronization with the decoding 
of the video data. In addition, even if master clocks re- 
ferred to during the encoding process are different from 



each other, the audio decoder is able to decode the au- 
dio while keeping it in synchronization. 
[001 5] It is acceptable to have an arrangement where- 
in the playback apparatus comprises a system register 
that stores therein a parameter showing a status setting 
of the playback apparatus, wherein whether the audio 
decoder decodes the. pieces of first audio data belong- 
ing to the first digital stream or the pieces of second au- 
dio data belonging to the second digital stream is deter- 
mined according to the parameter in the system register. 
[0016] With this arrangement, depending on the sta- 
tus setting of the playback apparatus, it is possible to 
switch between the audio in the first digital stream and 
the audio in the second digital stream; therefore, it is 
possible to treat the second digital stream on the sec- 
ondary recording medium and the first digital stream on 
the optical disc altogether as one. 
[0017] It is acceptable to have an arrangement where- 
in the secondary recording medium has playlist informa- 
tion recorded thereon, the playlist information showing 
a starting point and an ending point of a playback section 
in the first digital stream in correspondence with a start- 
ing point and an ending point of a playback section in 
the second digital stream, the playback apparatus com- 
prises a playback control unit operable to interpret the 
playlist information, and the readings by the first and the 
second reading units and the playback by the playback 
unit are performed based on a result of the interpretation 
by the playback control unit. 

[0018] With this arrangement, it is possible to, not only 
bring the first and second digital streams in correspond- 
ence with each other, but also to specify, in a case where 
a logical playback section is specified in the first digital 
stream, a section in the second digital stream that cor- 
responds to the logical playback section in the first dig- 
ital stream; therefore, it is possible to realize synchro- 
nized playback in units of logical sections. 
[001 9] It is acceptable to have an arrangement where- 
in the package management information further in- 
cludes alternative information, the playback control unit 
checks, prior to the interpretation of the playlist informa- 
tion, if the playlist information is damaged, and in a case 
where the playlist information is damaged, the playback 
control unit interprets playlist information indicated by 
the alternative information. 

[0020] With this arrangement, it is possible to recover 
data in a case where the playlist information on the sec- 
ondary recording medium is damaged; therefore, it is 
possible to assure stable playback. 
[0021 ] It is acceptable to have an arrangement where- 
in the secondary recording medium has a program re- 
corded thereon, the program showing a procedure for 
playback control of the first and the second digital 
streams using the playlist information, the playback ap- 
paratus comprises an execution module for executing 
the program recorded on the secondary recording me- 
dium, and the playback control unit interprets the playlist 
information based on a function call within the program. 
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[0022] With this arrangement, by referring to the pro- 
gram, it is possible to add, in a post factum manner, what 
procedure is used to perform the playback using the 
playlist information, after the optical disc is released. 
Thus, it is beneficial for after-sales services provided af- 5 
ter the optical disc is sold. 

[0023] It is acceptable to have an arrangement where- 
in the secondary recording medium has a plurality of 
package areas each of which is assigned to a different 
one of a plurality of optical discs to be mounted to the 10 
playback apparatus, when an optical disc is mounted to 
the playback apparatus, the control unit controls the first 
reading unit so that medium information is read from the 
mounted optical disc and specifies, out of the plurality 
of package areas in the secondary recording medium, '5 
a package area that corresponds to the read medium 
information, and the second digital stream read by the 
second reading unit exists in the specified package ar- 
ea. 

[0024] With this arrangement, it is possible to have a 20 
plurality of optical discs mounted to the playback appa- 
ratus and to record an updated version of each of the 
optical discs. 

[0025] It is acceptable to have an arrangement where- 
in the optical disc has playlist information, a program, 25 
and package management information recorded there- 
on, the playlist information shows a starting point and 
an ending point of a playback section in the first digital 
stream in correspondence with a starting point and an 
ending point of a playback section in the second digital 30 
stream, the program shows a procedure for playback 
control of the first and the second digital streams using 
the playlist information, the package management infor- 
mation is management information for the first digital 
stream, the second digital stream, the playlist informa- 35 
tion, and the program, the control unit controls the sec- 
ond reading unit so that any of the playlist information, 
the program, and the package management information 
that exists within the package area is read from the 
package area into the memory, and the control unit con- 40 
trols the first reading unit so that any of the playlist in- 
formation, the program, and the package management 
information that does not exist in the package area is 
read from the optical disc into the memory. 
[0026] It is also acceptable to have an arrangement 45 
wherein in a case where the playlist information or the 
program having an identification number in common is 
recorded both on the optical disc and in the package 
area, the control unit controls the second reading unit 
so that the playlist information or the program recorded so 
in the package area is read into the memory, and in a 
case where the playlist information or the program hav- 
ing an identification number is recorded only on the op- 
tical disc, the control unit controls the first reading unit 
so that the playlist information or the program recorded 55 
on the optical disc is read into the memory. 
[0027] With this arrangement, if a new updated ver- 
sion does not include one or more of the playlist infor- 



mation, the program, and the package management in- 
formation, it is possible to use data on the optical disc 
to supplement what is missing; therefore, there is no 
need to transmit all of the data to the user as an updated 
version. Accordingly, since it is possible to minimize the 
volume of what is supplied to the user as an updated 
version, the technique is suitable for transmission of up- 
dated versions via the Internet. 
[0028] The playback apparatus described above 
needs to perform the reading from the secondary re- 
cording medium in parallel with the reading from the op- 
tical disc. In a case where the secondary recoding me- 
dium is an HD, an ED scan needs to be performed be- 
cause it is necessary to (i) check if an updated version 
exists in a directory somewhere in the HD and (ii) deter- 
mine, if there are more than one updated version, which 
is the newest updated version. When such an HD scan 
needs to be performed, it takes a while between the 
loading of the optical disc and the start of the actual 
reading in parallel. The user who has loaded the optical 
disk onto the playback apparatus may feel an urge to 
view the movie production recorded on the optical disc 
as soon as possible. Users find it quite unpleasant to 
have a delay in the playback processing of an optical 
disc, due to whether there is a possibility of upgrading 
to a higher version or not. 

[0029] In order to solve the problem mentioned here, 
the present invention provides an optical disc on which 
a first digital stream and a flag are recorded, the flag 
indicating whether or not there is a possibility an updat- 
ed version of what is recorded on a recording medium 
is supplied, wherein the updated version includes a sec- 
ond digital stream and correspondence information 
which shows the first digital stream on the optical disc 
in correspondence with the second digital stream. 
[0030] With this arrangement, when an optical disc 
that has completely no possibility of being upgraded to 
a higher version is loaded, it is possible to start the play- 
back of the digital streams recorded on the optical disc 
immediately after the optical disc is loaded, without per- 
forming an HD scan. 

Brief Description Of The Drawings 

[0031] 

FIG. 1 shows an embodiment related to the usage 

of the playback apparatus of the present invention; 

FIG. 2 shows the configuration of a BD-ROM; 

FIG. 3 represents an application format of a 

BD-ROM, using a directory structure; 

FIG. 4 is a classification diagram in which files are 

classified in terms of their functions; 

FIG. 5 shows a layer model of software targeted by 

a BD-ROM; 

FIG. 6 schematically shows how an AV stream is 
structured; 

FIG. 7 schematically shows how an AV stream is 
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recorded on a BD-ROM; 
FIG. 8 shows the internal structure of stream man- 
agement information; 

FIG. 9 shows the internal structure of PL informa- 
tion; 5 
FIG. 10 schematically shows an indirect reference 
with PL information; 

FIG. 11 shows an example in which a PL different 
from the PL shown in FIG. 10 is defined; 
FIG. 1 2 shows the internal structure of the playback 10 
apparatus 200; 

FIG. 13 shows in comparison an AV stream in a 
BD-ROM package and an AV stream in an update 
kit; 

FIG. 14 shows in comparison the substance of an '5 
ACCESS UNIT in a BD-ROM package (XXX. TS) 
and the substance of an ACCESS UNIT in an up- 
date kit (UXX. TS); 

FIG. 15 shows stream management information in 
an update kit: 

FIG. 16 shows in comparison packets that consti- 
tute an ACCESS UNIT on a BD-ROM and packets 
that constitute an ACCESS UNIT in an update kit; 
FIG. 17 shows the internal structure of PL informa- 
tion (UYY. PL); 25 
FIG. 18 shows an indirect reference with UYY.PL, 
describing in the same manner as FIG. 1 0; 
FIG. 19 is a flow chart that shows the processing 
procedure performed by the control unit 1 6 accord- 
ing to the first embodiment; 30 
FIG. 20 shows the reading process in Steps S4 
through S11; 

FIG. 21 shows what kind of audio playback is 
achieved as a result of the output switching shown 
in FIG. 20; 35 
FIG. 22 shows how an ACCESS UNIT is structured 
in an AV stream according to the second embodi- 
ment; 

FIG. 23 shows in comparison the substance of an 
ACCESS UNIT in a BD-ROM package (XXX. TS) 40 
and the substance of an ACCESS UNIT in an up- 
date kit (UXX.TS), describing in the same manner 
as FIG. 14; 

FIG. 24 shows the internal structure of PL informa- 
tion included in an update kit according to the sec- 45 
ond embodiment; 

FIG. 25 shows speech information; 
FIG. 26 shows the internal structure of the playback 
apparatus according to the second embodiment; 
FIG. 27 shows the processing procedure performed so 
by the" control unit 16 according to the second em- 
bodiment; 

FIG. 28 shows the reading process performed by 
the control unit 1 6 to read from a BD-ROM and from 
the HD; 55 
FIG. 29 shows what kind of subtitle display is 
achieved as a result of the output switching shown 
in FIG. 28; 



FIG. 30A shows what is recorded on a BD-ROM ac- 
cording to the third embodiment; 
FIG. 30B shows what is recorded on the HD accord- 
ing to the third embodiment; 
FIG. 31 shows how the positions of the ILVUs con- 
stituting the multi angle section shown in FIG. 30 
are managed; 

FIG. 32 shows the structure of the stream manage- 
ment information according to the third embodi- 
ment; 

FIG. 33 shows the internal structure of the PL infor- 
mation according to the third embodiment; 
FIG. 34 schematically shows indirect reference with 
Angle Entries included in PL information; 
FIG. 35 shows the internal structure of the playback 
apparatus according to the third embodiment; 
FIG. 36 is a flow chart that shows the processing 
procedure performed by the control unit 1 6 accord- 
ing to the third embodiment; 
FIG. 37 shows the process of parallel reading per- 
formed by the switch 18 to read from a BD-ROM 
and from the HD; 

FIG. 38 shows what video display is achieved as a 
result of the output switching shown in FIG. 37; 
FIG. 39 shows a home theater system according to 
the fourth embodiment; 

FIG. 40 shows stream management information ac- 
cording to the fourth embodiment; 
FIG. 41 shows PL information according to the 
fourth embodiment; 

FIG. 42 shows the internal structure of the playback 
apparatus according to the fourth embodiment; 
FIG. 43 shows the processing procedure performed 
by the control unit 16 according to the fourth em- 
bodiment; 

FIG. 44 shows the details of the fourth layer in a 
layer model; 

FIG. 45A shows an example of description of a dy- 
namic scenario; 

FIG. 45B shows another dynamic scenario that can 
be used in place of the dynamic scenario shown in 
FIG. 45A; 

FIG. 46A shows the playback procedure with a dy- 
namic scenario recorded on a BD-ROM; 
FIG. 46B shows the playback procedure with a dy- 
namic scenario included in an update kit; 
FIG. 47 shows the internal structure of the playback 
apparatus according to the fifth embodiment; 
FIG. 48A shows what is recorded on a BD-ROM; 
FIG. 48B shows an update kit for the BD-ROM 
shown in FIG. 48A; 

FIG. 49A and FIG. 49B schematically show the 
playback procedure realized with a dynamic sce- 
nario recorded on a BD-ROM and a dynamic sce- 
nario included in an update kit; 
FIG. 50A shows PL #1 , PL #2, and a dynamic sce- 
nario that are recorded on a BD-ROM; 
FIG. 50B shows an update kit; 
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FIG. 5 1 A shows a dynamic scenario that defines the 
playback order (PL #1, PL #2); 
FIG. 51 B shows the playback procedure with a re- 
placement dynamic scenario; 
FIG. 52 shows a directory structure of an HD ac- 
cording to the sixth embodiment; 
FIG. 53 shows the internal structure of INFO.BD; 
FIG. 54 shows the processing procedure by the 
module manager 26 according to the sixth embod- 
iment; 

FIG. 55A and FIG. 55B show the processing proce- 
dure by the module manager 26 according to the 
sixth embodiment; 

FIG. 56 schematically shows the process of reading 
files stored on a BD-ROM , in the Version 1 directory, 
and in the Version 2 directory; 
FIG. 57 shows the structure of a virtual package ta- 
ble; 

FIG. 58 shows the structure of a virtual package ta- 
ble for INFO.BDs; 

FIG. 59 is a flowchart that shows the processing 
procedure by the module manager 26 according to 
the seventh embodiment; 

FIG. 60 shows a screen showing a list in Step S82; 
FIG. 61 is a flow chart that shows the processing 
procedure by the module manager 26 according to 
the eighth embodiment; 

Fig. 62 shows the structure of the playback appa- 
ratus 200 according to the ninth embodiment; 
FIG. 63 shows a variation of PL information; and 
FIG. 64A and FIG. 64B show variations for the in- 
ternal structure of the playback apparatus 200. 

Best Mode for Carrying Out the Invention 

FIRST EMBODIMENT 

[0032] The following describes an embodiment of the 
recording medium according to the present invention. 
First of all, among different actions with the playback ap- 
paratus of the present invention, an embodiment of us- 
age will be explained. FIG. 1 shows an embodiment re- 
lated to the usage of the playback apparatus of the 
present invention. In FIG. 1 , the playback apparatus of 
the present invention is the playback apparatus 200. 
The playback apparatus 200, the television 300, and the 
remote controller 400 form a home theater system. The 
BD-ROM 100 is a recording medium to supply a movie 
production to this home theater system. The playback 
apparatus 200 serves to play back the movie production 
recorded on the BD-ROM 100, according to a user op- 
eration on the remote controller 400. 
[0033] The home theater system is characterized with 
that the playback apparatus 200 is connected with a 
WWW server 500 via a network. In response to a re- 
quest from the playback apparatus 200, the WWW serv- 
er 500 transmits an update kit for what is recorded on 
the BD-ROM 100 to the playback apparatus 200. When 



the update kit has been transmitted, the playback appa- 
ratus 200 dynamically combines the update kit with what 
is recorded on the BD-ROM 1 00 and performs the play- 
back of a package in a virtual version (called a "virtual 

5 package' 1 ). 

[0034] A virtual package is a package being virtual to 
be supplied to a user in which what is recorded on the 
BD-ROM 100 is dynamically combined with an update 
kit. In contrast to a virtual package, what is recorded on 

10 a BD-ROM as a whole is called a BD-ROM package. 
[0035] The following describes a BD-ROM package, 
with reference to FIGs. 2 through 11. 
[0036] FIG. 2 shows the structure of a BD-ROM. In 
the drawing, the level 4 shows the BD-ROM, and the 

15 level 3 shows the track on the BD-ROM. In the drawing, 
the track that actually forms a spiral from the inner cir- 
cumference to the outer circumference of the BD-ROM 
is shown as being stretched sideways. The track in- 
cludes a lead-in area, a volume area, and a lead-out 

20 area. The volume area shown in the drawing has a layer 
model with a physical layer, a file system layer, and an 
application layer. An optical disc according to the 
present embodiment can be industrially manufactured 
by forming a data format as shown in FIG. 2 on an ap- 

25 plication layer of a BD-ROM. 

[0037] FIG. 3 represents an application format of a 
BD-ROM, using a directory structure. As shown in the 
drawing, below a ROOT directory in the BD-ROM is a 
BD-AV directory, and below the BD-AV directory is a 

30 JCLASS directory and a BROWSER directory. 

[0038] Subordinate to the BD-AV directory are dis- 
posed files such as INFO. BD, XXX. M2TS, XX. CLPI, 
YYY. PL, and ZZZ. MOVIE. Subordinate to the JCLASS 
directory is disposed a file called ZZZ. CLASS, and sub- 

35 ordinate to the BROWSER directory is disposed a file 
called ZZZ.HTML. 

[0039] FIG. 4 is a classification diagram in which files 
are classified in terms of their functions, In the drawing, 
the hierarchy formed with the first, second, third, and 

40 fourth layers symbolically shows the classifications in 
the diagram. In the drawing, XXX.M2TS is grouped in 
the second layer. XXX. CLPI and YYY. PL are grouped in 
the third layer (static scenarios). ZZZ.MOVIE, which is 
subordinate to the BD-AV directory, ZZZ.CLASS, which 

45 j S subordinate to the JCLASS directory, ZZZ. HTM, 
which is subordinate to the BROWSER directory are 
grouped in the fourth layer. 

[0040] The classifications in the drawing (the first to 
fourth layers) target a layer model such as shown in FIG . 

so 5. A layer model in control software that is targeted by 
a BD-ROM is described below while referring to FIG. 5. 
[0041] The first layer in FIG. 5 is a physical layer in 
which supply controls relating to streams targeted for 
processing are implemented. As shown in the first layer, 

55 target streams have as their supply source not only 
BD-ROMs but also HDs (hard disks), memory cards, 
networks and other kinds of recording and communica- 
tion media. Controls (disk access, card access and net- 
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work communication) directed towards the supply 
source such as HDs, memory cards, and networks are 
implemented on the first layer. 
[0042] The second layer is a decoding format layer. 
This second layer is where the decoding format used in 
decoding streams supplied by the first layer Is defined. 
The MPEG-2 decoding format is employed in the 
present embodiment. 

[0043] The third layer (static scenarios) defines the 
static scenarios of streams. Static scenarios are play- 
back path information and stream management infor- 
mation defined in advance by the disk creator, the third 
layer (static scenarios) being where playback controls 
based on these static scenarios are defined. 
[0044] The fourth layer is for realizing dynamic sce- 
narios in streams. Dynamic scenarios are scenarios for 
dynamically changing the progress of playback as a re- 
sult of user operations, the apparatus status, and the 
like, the fourth layer being where playback controls 
based on these dynamic scenarios are defined. Files re- 
lating to streams and static scenarios are described be- 
low in accordance with this layer model. 
[0045] Firstly, a stream (XXX.M2TS) belonging to the 
second layer is described. 

[0046] The AV stream (XXX.M2TS) is an MPEG-TS 
(transport stream) format digital stream obtained by 
multiplexing a video stream, one or more audio streams, 
and one or more sub-image streams. Video streams 
show the moving image portions of a movie, audio 
streams show the audio portions of a movie, and sub- 
image streams show the subtitles of a movie. FIG. 6 
schematically shows how an AV stream is structured. 
[0047] An AV stream (the level 4) is formed by con- 
verting a video stream comprising a plurality of video 
frames (pictures pj1 , pj2, pj3) and an audio stream com- 
prising a plurality of audio frames (the level 1 ) into a PES 
packet sequence (the level 2), which is then converted 
to TS packets (the level 3). Likewise, a sub- image 
stream (the level 7) is converted into a PES packet se- 
quence (the level 6), which is converted to TS packets 
(the level 5), and they are then multiplexed. The multi- 
plexing involves arranging TS packets storing video 
frames and TS packets storing audio frames, so that au- 
dio frames are positioned close to video frames that are 
to be read from the BD-ROM at the same time as the 
audio frames. 

[0048] An AV stream generated through the above 
process is portioned into a plurality of extents and re- 
corded in an area of a BD-ROM, in the same manner as 
normal computer files. FIG. 7 schematically shows how 
an AV stream is recorded on a BD-ROM. 
[0049] The length of each of the extents constituting 
the AV stream and at which address in the BD-ROM 
each of the extents is recorded are described in the file 
management information fk1. 
[0050] The file management information fk1 de- 
scribes, for each of the extents 1 , 2, and 3 that are ob- 
tained by portioning the AV stream, the address of the 



extent (adr 1, adr 2, and adr 3) and the length of the 
extent (length 1 , length 2, and length 3). An AV stream 
comprises one or more ACCESS UNITS, and can be 
cued in these ACCESS UNITS. An ACCESS UNIT is 

5 the smallest decoding unit that includes a single GOP 
(group of pictures) and audio frames to be read at the 
same time as the GOP. GOPs include bi-directionally 
predictive (B) pictures, which are compressed using 
time-correlation characteristics with images to be 

10 played in a past direction and a future direction, predic- 
tive (P) pictures, which are compressed using time-cor- 
relation characteristics with images to be played in a 
past direction, and intra (I) pictures, which are com- 
pressed using spatial-frequency characteristics (i.e. not 

*5 time-correlation characteristics) in the images of individ- 
ual frames. 

[0051] Moreover, the file name "XXX" in XXX.M2TS 
abstracts the 3-digit identification number appended to 
the AV stream in the BD-ROM. That is, the AV stream 
20 in the drawing is uniquely identified using the "XXX". 
Thus, the description of the stream (XXX.M2TS) is com- 
pleted. It should be noted that the 3-digit number re- 
ferred-to here is merely exemplary, and may be any 
length. 

25 

Static scenarios 

[0052] The files (XXX. CLPI, YYY. PL), which are stat- 
ic scenarios, are described next. 

30 [0053] Stream management information (XXX. CLPI) 
is management information relating to individual AV 
streams. FIG. 8 shows the internal structure of stream 
management information. An AV stream is obtained by 
multiplexing video and audio streams, and since an AV 

35 stream can be cued in ACCESS UNITs, management 
items of the stream management information include 
what attributes the video and audio streams have and 
where the cue positions are in the AV stream. The lead- 
ers in the drawing highlight the stream management in- 

40 formation structure. As shown by the leader hn1, the 
stream management information (XXX.CLPI) compris- 
es "attribute information" relating to video and audio 
streams, and "TMAP", which is a reference table for cue- 
ing ACCESS UNITS. 

45 [0054] Attribute information (Attribute), as shown by 
the leader hn2, comprises attribute information relating 
to a video stream (Video attribute information), an at- 
tribute information number (Number), and attribute in- 
formation relating to each of a plurality of audio streams 

50 multiplexed on the AV stream (Audio attribute informa- 
tion #1-#m). The management information on video 
streams, as shown by the leader hn3, shows the com- 
pression format used to compress the video stream 
(Coding), and the resolution (Resolution), the aspect ra- 

55 tio (Aspect), and the frame rate (Framerate) of individual 
pieces of picture data structuring the video stream. 
[0055] On the other hand, attribute information relat- 
ing to the audio streams (Audio attribute information 
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//1-ffM), as shown by the leader hn4, shows the com- 
pression format used to compress the respective audio 
streams (Coding), and the channel number (Ch.) and 
the corresponding language (Lang.) of respective audio 
streams. 

[0056] The time map (TMAP) is a reference table for 
referring indirectly to the addresses of a plurality of cue 
positions using time information, and, as shown by the 
leader hn5, comprises a plurality of pieces of ENTRY 
information (ACCESS UNIT#1 ENTRY information, AC- 
CESS UNIT #2 ENTRY information, ACCESS UNIT #3 
ENTRY information, ...) and an entry information 
number (Number). Each piece of ENTRY information, 
as shown by the leader hn6, shows a playback time pe- 
riod (Duration) of a corresponding ACCESS UNIT in cor- 
respondence with the data size (Size) of the corre- 
sponding ACCESS UNIT Because of employing a var- 
iable-length coding compression format, it is possible to 
cue from an arbitrary playback time to a piece of picture 
data in an ACCESS UNIT corresponding to the playback 
time by referring to the ENTRY information of the AC- 
CESS UNIT, even when sizes and playback times of AC- 
CESS UNITS that include GOPs are not uniform. More- 
over, the file name "XXX" of XXX. CLPI uses the same 
name as the AV stream to which the stream manage- 
ment information corresponds. In other words, the file 
name of the AV stream in the drawing, being "XXX", cor- 
responds to the AV stream ,, XXX.M2TS". Thus con- 
cludes the description of the stream management infor- 
mation. Playlist information is described next. 
[0057] YYYPL (PlayList information) is a table struc- 
turing a PlayList, which is a playback path , and compris- 
es a CellList. FIG, 9 shows the internal structure of PL 
information. 

[0058] The CellList includes a plurality of pieces of 
CELL information (CELL information #1, #2, #3, ... #n) 
and a CELL information number (NUMBER). Each 
piece of CELL information is pointer information that de- 
fines one or more playback logical sections structuring 
a PlayList. The structure of CELL information is high- 
lighted by the leader hsl. The CELL information is, as 
shown by the leader hsl, structured from an "AV Stream 
Name" showing the name of the AV stream to which the 
In-point and out-point of a playback section belong, "IN 
point information" showing the start of a playback sec- 
tion, and "Out point information", showing the end of the 
playback section. 

[0059] A characteristic of the CELL information is the 
notation. That is, playback sections are def ined by an 
indirect referencing format that uses a time map as a 
reference table. FIG. 10 schematizes indirect referenc- 
ing using PL information. The AV stream in the drawing 
is structured from a plurality of ACCESS UNITs. The 
TMAP in the stream management information specifies 
the sector addresses of the ACCESS UNITs, as shown 
by the arrows ay1 , ay2, ay3, and ay4. Arrows jy1, jy2, 
jy3, and jy4 in the drawing schematically show the ref- 
erencing of ACCESS UNITs using CELL information. In 



other words, this shows that referencing with the CELL 
information (the arrows jy1, jy2, jy3, and jy4) involves 
indirect referencing in which the addresses of ACCESS 
UNITs included in the AV stream are specified via the 
TMAP. 

[0060] Playback sections on a BD-ROM formed from 
groupings of CELL information, stream management in- 
formation, and AV stream are called "CELLs". Logical 
playback units on a BD-ROM that are formed from 
groupings of PL information, stream management infor- 
mation and AV stream are called "PlayLists" (abbreviat- 
ed as "PL"). Movie productions recorded on a BD-ROM 
are structured in these logical playback units (PLs). 
Since movie productions on a BD-ROM are structured 
in logical playback units, it is possible to easily create, 
as distinct from the main movie production, movie pro- 
ductions from scenes in which only certain characters 
appear, for instance, by defining the PLs specifying only 
such scenes in which those characters appear. FIG. 11 
shows an example in which a PL (the PL information #2) 
different from the PL information (the PL information #1) 
shown in FIG. 10 is defined. 

[0061 ] The greatest merit of static scenarios is being 
able to increase the range of a moviemaker's expres- 
sion, since the variations of a movie production increase 
simply by defining different pieces of PL information. 
[0062] As another example of playback units on a 
BD-ROM, there are "chapters" besides PLs and CELLS. 
A "chapter" is constituted with one or more CELLS. 
[0063] It should be noted that the file name "YYY" in 
PL information abstracts the 3-digit identification 
number provided for the PL information in the BD-ROM . 
That is, the PL information in the drawing is uniquely 
identified using the identification number "YYY". It 
should be noted that an identification number of PL in- 
formation is expressed as "YYY" in order to indicate that 
the identification number of PL information has a differ- 
ent numbering system from the identification number 
XXX of AV streams and AV stream management infor- 
mation. (The 3-digit number referred to here is merely 
exemplary, and may be any length.) 
[0064] Thus, the description of the BD-ROM package 
is completed. The following describes the internal struc- 
ture of the playback apparatus 200. FIG. 12 shows the 
internal structure of the playback apparatus 200. As 
shown in the drawing, the playback apparatus 200 com- 
prises a BD drive 1 , a BD buffer 2, a demultiplexer 3, a 
video decoder 4, a picture plane 5, an audio decoder 6, 
an image decoder 7, an image plane 8, an adder 9, a 
static scenario memory 10, a download unit 11, a local 
HD 12, an HD buffer 13, a demultiplexer 14, a switch 
15, and a control unit 16. 

[0065] The BD drive 1 performs loading/ejecting of 
BD-ROMs, and accesses loaded BD-ROMs. 
[0066] The 3D buffer 2 is a FIFO memory, and AC- 
CESS UNITs read from a BD-ROM are stored in a first- 
in-first-out manner. 

[0067] The demultiplexer 3 takes ACCESS UNITs out 
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of the BD buffer 2 and demultiplexes the ACCESS 
UNITs so as to obtain video frames and audio frames 
that constitute GOPs. The demultiplexer 3 outputs the 
video frames to the video decoder 4, the audio frames 
to the audio decoder 6, and the sub-image stream to the 
image decoder 7. The demultiplexing process per- 
formed by the demultiplexer 3 includes a conversion 
processing to convert TS packets into PES packets. The 
demultiplexing process performed by the demultiplexer 
3 is to take PES packets, which are the payloads, out of 
TS packets constituting an AV stream that has been 
read from a BD-ROM, to then take the main-body data 
(including three kinds of data such as video frames, au- 
dio frames and sub-image units), which is the payload, 
out of the PES packets, and to output the main-body 
data to the video decoder 4, the audio decoder 6, and 
the image decoder 7, based on the TS packets attached 
to the TS packets. In a case where the PID (Packet ID) 
attached to a TS packet indicates a video stream, the 
main-body data of the PES packet is outputted to the 
video decoder 4. In a case where the PID indicates an 
audio stream, the main-body data is outputted to the au- 
dio decoder 6 . The demultiplexing process of TS pack- 
ets is performed with reference to a time stamp such as 
PCR (Program Clock Reference) or ATS (Arrival Time 
Stamp) that is attached to each TS packet. That is to 
say, when the clock inside the playback apparatus 
reaches the time indicated by the time stamp on a TS 
packet, the demultiplexer 3 demultiplexes the TS packet 
as described above. 

[0068] The video decoder 4 decodes the video frames 
outputted from the demultiplexer 3 and writes pictures 
in an uncompressed format into the video plane 1 5. 
[0069] The picture plane 5 is a memory for storing pic- 
tures in an uncompressed format. 
[0070] The audio decoder 6 decodes the audio 
frames outputted from the demultiplexer 3 and outputs 
audio data in an uncompressed format. 
[0071] The image decoder 7 expands sub-image 
streams that have been compressed and encoded and 
writes the expanded sub-image streams to the image 
plane 8. As a result of the decoding of the sub-image 
streams, menus and sub-images are displayed on a 
screen. 

[0072] The image plane 8 is a memory having an area 
for one screen of image. Expanded sub-image streams 
are arranged on the image plane 8. 
[0073] The adder 9 combines the picture data in an 
uncompressed format stored in the picture plane 5 with 
the expanded image in the image plane 8 and outputs 
the combined. 

[0074] The static scenario memory 1 0 is a memory for 
storing "current PL information" and "current stream 
management information". "Current PL information" de- 
notes a piece of PL information that is currently a target 
of processing, among a plurality of pieces of PL infor- 
mation recorded on a BD-ROM. "Current stream man- 
agement information" denotes a piece of stream man- 



agement information that is currently a target of 
processing, among a plurality of pieces of stream man- 
agement information recorded on a BD-ROM. 
[0075] The download unit 11 performs FTP (File 
5 Transfer Protocol) communication with the WWW serv- 
er 500 and downloads an update kit from the WWW 
server 500 so as to write the downloaded update kit to 
the local HD 12. 

[0076] The local HD 12 is a built-in disc device into 

10 which the update kit is written, In the drawing, a directory 
structure is drawn to fit inside the local HD 12. In the 
directory structure in the local HD 1 2, subordinate to the 
ROOT directory is disposed the directory "abc" in which 
the update kit is disposed. The directory name "abc" in 

'5 the drawing is the same name as the volume label of 
the BD-ROM that corresponds to the update kit. That is 
to say, in the local HD 12, the update kit is recorded into 
the directory named "abc", which is the same name as 
the volume label "abc". 

20 [0077] When downloading the update kit, the down- 
load unit 1 1 reads the volume label of the BD-ROM "abc" 
and generates a directory having the same name "abc" 
in the local HD 12. Subsequently, the download unit 11 
accesses the WWW server 500, downloads the update 

25 kit, and writes the downloaded update kit to the directory 
"abc" having the directory name being the same as the 
volume label. 

[0078] Inside the box with broken lines in the drawing 
shows the files constituting the update kit. As shown with 

30 the box with broken lines, the update kit is constituted 
with an additional AV stream "UXX. M2TS", additional 
stream management information "UXX.CLPI", and PL 
information for updating "UYY.PL". 
[0079] The HD buffer 1 3 is a buffer into which one of 

35 the ACCESS UNITs constituting the additional stream 
(UXX.M2TS) recorded in the local HD 12 is read, every 
time one of ACCESS UNITS constituting the AV stream 
recorded on a BD-ROM is read into the BD buffer 2. 
[0080] The demultiplexer 14 demultiplexes the AC- 

40 CESS UN IT that is in an MPEG-TS format and has been 
read into the HD buffer 13 so as to obtain data before 
being multiplexed (In the case of the present embodi- 
ment, the data is audio frames). 
[0081 ] The switch 1 5 selectively outputs, to the audio 

45 decoder 6, one of the audio frames in the access unit 
read into the BD buffer 13 and the audio frames in the 
access unit read into the BD buffer 2. The switching be- 
tween the outputs is performed by the switch 15 based 
on SPRM (1 ) (audio stream number). SPRM (1 ) is a reg- 

50 jster by which the status of the playback apparatus is 
shown, 

[0082] The control unit 16 is a typical computer sys- 
tem that includes a CPU, a ROM storing programs, and 
a RAM. The control unit 16 realizes computation or 
55 processing of information that suits the purpose of us- 
age through collaboration of the program and the hard- 
ware resources after the program stored in the ROM is 
read into the CPU. The purpose of usage may be, for 
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example, (i) to play back PLs recorded on a BD-ROM, 

(ii) to download an update kit from the WWW server 500, 

(iii) to play back a virtual package in which a BD-ROM 
package and an update kit is combined. When a specific 
means in which a program and hardware resources (the 
BD drive 1 - the switch 15) collaborate achieves com- 
putation or processing of information that suits the pur- 
pose of usage, a specific information processing appa- 
ratus (the playback apparatus 200) that suits the pur- 
pose of usage is structured. 

[0083] The control unit 1 6 has a built-in register (play- 
er register) that shows the status setting of the playback 
apparatus 200. The player register has 32 System Pa- 
rameter Registers and 32 General Purpose Registers. 
What is meant by the set values (SPRM) of the Player 
status Registers are shown below. In the following sec- 
tion, SPRM(x) denotes a value set in an x'th Player Sta- 
tus Register. 

SPRM(0): Reserved; 

SPRM(1): The stream number of an audio stream 
to be decoded; 

SPRM(2) : The stream number of a sub-image 
stream to be decoded; 

SPRM(3): The number for an angle setting by the 
user; 

SPRM(4): The number of a title currently being a 
target of playback; 

SPRM(5): The number of a chapter currently being 
a target of playback; 

SPRM (6) : The number of a PL currently being a 
target of playback; 

SPRM(7): The number of a CELL currently being a 
target of playback; 

SPRM(8): The time information indicating a current 
playback point of time; 

SPRM(9): The count value of the navigation timer; 
SPRM(10): The number of a button currently being 
selected; 

SPRM(11)-SPRM(12): Reserved; 
SPRM(13): A parental level setting by the user; 
SPRM(1 4): Setting related to image playback by the 
playback apparatus; 

SPRM(15): Setting related to audio playback by the 
playback apparatus; 

SPRM(16): A language code indicating the audio 

setting on the playback apparatus; 

SPRM(1 7): A language code indicating the subtitle 

setting on the playback apparatus; 

SPRM(18): A language setting for menu drawing; 

SPRM(19) - SPRM (31): Reserved 

[0084] Here, SPRM(10) is updated every time each 
piece of picture data belonging to an AV stream is dis- 
played. That is to say, when the playback apparatus has 
a new piece of picture data displayed, SPRM(1 0) is up- 
dated to a value that indicates the display starting time 
(Presentation Time) of the new piece of picture data. By 



referring to SPRM(10), it is possible to find out the cur- 
rent playback point of time. 

[0085] When setting SPRM, the control unit 16 dis- 
plays a menu. This menu is for receiving an audio set- 

5 ting, a subtitle setting, an angle setting, and a parental 
setting from the user. When the user performs an oper- 
ation on the menu, a value stored in a register is updated 
according to the operation on the menu. SPRM is up- 
dated not only via the menu, but also when the user per- 

10 forms an operation on the remote controller 400. 

[0086] Thus, the description of the playback appara- 
tus according to the present embodiment is completed. 
[0087] The following describes AV streams, stream 
management information, and PL information in an up- 

15 date kit stored in the local HD 12. 

[0088] The AV stream (UXX.M2TS) in an update kit is 
for adding new audio to the AV stream recorded on a 
BD-ROM. FIG. 13 shows in comparison an AV stream 
in a BD-ROM package and an AV stream in an update 

20 kit. The AV stream in an update kit is made up of AC- 
CESS UNITs that are equal in number to the ACCESS 
UNlTs that make up an AV stream in a BD-ROM pack- 
age. 

[0089] FIG. 14 shows in comparison the substance of 

25 an ACCESS UNIT in a BD-ROM package (XXX.TS) and 
the substance of an ACCESS UNIT in an update kit 
(UXX.TS). The upper level of FIG. 14 is an ACCESS 
UNIT on a BD-ROM. The lower level is an ACCESS 
UNIT in an update kit. In the drawing, the ACCESS 

30 UNITS #98, #99, #100, #1 01 , and #1 02 are to be played 
back 1 minute and 38 seconds, 1 minute and 39 sec- 
onds, 1 minute and 40 seconds and 1 minute and 41 
seconds after the beginning of the playback of the AV 
stream, respectively. (In this example, the playback time 

35 of one ACCESS UNIT is approximated to one second). 
[0090] As we focus on the ACCESS UNITS, the AC- 
CESS UNIT #100 on the BD-ROM side includes a GOP 
to be played back at 1 minute and 40 seconds and an 
audio frame sequence (musical note symbols in the 

40 drawing) to be read at that time. On the other hand, the 
ACCESS UNIT #100 on the update kit side includes an 
audio frame to be played back at 1 minute and 40 sec- 
onds. The white bold arrow in the drawing shows the 
playback time of each ACCESS UNIT. The playback 

45 time is different from one ACCESS UNIT to another be- 
cause since the playback time of each ACCESS UNIT 
is based on the GOP. Each of the ACCESS UNITs in an 
update kit has a playback time that is the same as the 
corresponding ACCESS UNIT recorded on the 

50 BD-ROM. 

[0091] Because of an arrangement wherein the AV 
stream in the update kit includes ACCESS UNITS which 
are equal in number to the ACCESS UNITS in the AV 
stream recorded on the BD-ROM, and wherein the AC- 

55 CESS UNITs in the AV stream in the update kit includes 
audio frames having the equal time length to the audio 
frames included in the ACCESS UNITS recorded on the 
BD-ROM, the ACCESS UNITS in the AV stream record- 
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ed on the BD-ROM are in one-to-one correspondence 
with the ACCESS UNITs in the AV stream in the update 
kit. Thus, the description of the AV stream in the update 
kit is completed. The following describes the stream 
management information in the update kit. 5 
[0092] The stream management information in the 
update kit (UXX. CLPI) is related to AV streams with only 
audio and is supplied by the WWW server 500 along 
with the AV stream with only audio. FIG. 15 shows 
stream management information in an update kit. This io 
stream management information also has a TMAP, like 
the one shown in FIG. 8, in which the data size and the 
starting time of each ACCESS UNIT are described. 
Since a TMAP that is similar to the one for the AV stream 
recorded on the BD-ROM exists, the AV stream in the '5 
update kit can be cued in ACCESS UNITs. The stream 
management information is different from different from 
the stream management information in FIG. 8 in that, 
since no video stream is multiplexed, (i) the video at- 
tribute is set as "no video" and (ii) "Offset" is added to 20 
the audio attribute. The following explains "Offset" add- 
ed to the audio attribute, with reference to FIG. 1 6. FIG. 
16 shows in comparison packets that constitute an AC- 
CESS UNIT on a BD-ROM and packets that constitute 
an ACCESS UNIT in an update kit. In the drawing, "V" 25 
denotes a video packet, and "A" denotes an audio pack- 
et. A time stamp is given to each of these packets. The 
time stamp is time information for informing the playback 
apparatus of the processing timing, i. e. when process- 
ing should be performed. A time stamp with the value 30 
"702" is given to an audio packet positioned first in an 
ACCESS UNIT in the AV stream released on a 
BD-ROM. Time stamps with larger values such as "703", 
M 704", "705", "706" and so on are given to the audio 
packets that follow this audio packet. On the other hand, 35 
a time stamp with the value "150" is given to an audio 
packet positioned first in an ACCESS UNIT in an AV 
stream in the update kit. Time stamps with values su- 
chas "151", "152", "153", "154", ,, 155 ,, and so on are giv- 
en to the audio packets that follow this audio packet, so *o 
that the more later the audio packet is positioned, the 
larger the value of the time stamp is. 
[0093] There are differences between the time 
stamps because of the difference between the master 
clocks at the times of encoding. The master clocks are 4 $ 
clock signals which are referred to at the time of encod- 
ing in order to give a time stamp. Because of this refer- 
ence to each master clock, the plurality of audio packets 
in an AV stream have time stamps that have serial val- 
ues attached. However, when an AV stream in the up- 50 
date kit and an AV stream recorded on the BD-ROM are 
compared, the master clocks to be referred to as the 
time stamps are given are different between the former 
case and the latter case. Thus, the values of the time 
stamps given to the respective audio packets are natu- 55 
rally different between those cases. Since the time 
stamps on the audio packets included in the respective 
ACCESS UNITs are largely different , it is not possible 



to switch between the audios in those two AV streams, 
as the way they are. Accordingly, the differences be- 
tween the time stamps are described in "Offset" in the 
stream management information. 
[0094] Because the offsets are described in the 
stream management information, even if the master 
clock to be referred to is different, it is possible to play 
back, in synchronization, the audio packets in the AV 
stream recorded on the BD-ROM with the audio packets 
in the AV stream in the update kit. Thus, the description 
of the stream management information in the update kit 
is completed. The following describes the PL informa- 
tion in the update kit (UYY. PL). 
[0095] The PL information in the update kit (UYY. PL) 
is to be used in place of the PL information on the 
BD-ROM. The PL information in the update kit is differ- 
ent from the PL information recorded on the BD-ROM 
in that the PlayLists in the PL information are defined by 
arranging a bundle of playback sections in accordance 
with the order in which they are played back. "A bundle 
of playback sections" means playback sections that are 
defined on a plurality of AV streams and are to be played 
back in synchronization with one another. FIG. 1 7 shows 
the internal structure of PL information (UYY. PL) . Each 
piece of CELL information in FIG. 17 is constituted with 
"Clip Entry" indicating the AV stream on the BD-ROM, 
"Audio Table", "Subtitle Table" and "Number" indicating 
the number of Clip Entries. 

[0096] "Clip Entry" includes "AVStream Name", "In 
point information", and "Out point information" of the 
CELL information on the BD-ROM. They are the same 
as the "Cell Entries" of the CELL information shown in 
FIG. 9. The Audio Table is made up of a plurality of Audio 
Entries (Audio Entries #1 - #n) . Each of the Audio Entries 
defines (i) which stream is an audio stream that can be 
played back in the CELL, (ii) to which AV stream, the 
audio stream belongs, and (iii) from where to where in 
the stream forms a playback section, using the file name 
of the AV stream (AVStream Name), the identifier of the 
audio stream (Audio Stream ID), the information indicat- 
ing the starting point of the playback section in the AV 
stream (In point information), the information indicating 
the ending point of the playback section in the AV stream 
(Out point information), and the offset (Offset). 
[0097] For example, the AV stream #1 is recorded on 
the BD-ROM, and the AV stream #2 is downloaded by 
the playback apparatus as an update kit and stored in 
the local HD 12. As additional information, it is assumed 
that the AV stream #1 includes moving pictures (video) 
and English audio, whereas the AV stream #2 includes 
Japanese audio, which is a second language. The Jap- 
anese audio is stored in an AV stream being different 
from the one in which the video is stored, so that it is 
possible to distribute the Japanese audio in an update 
kit. In such a case, it is arranged so that Clip Entry #1 
in the Cell defines the playback section on the AV stream 
#1, and Audio Entry #1 describes the AVStream Name 
and the Audio Stream ID for the AV stream that is for 
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the Japanese audio. By distributing the piece of PL in- 
formation that includes CELL information described as 
above along with AV stream #2 from the WWW server 
500 and combining the PlayLists recorded on the 
BD-ROM, it is possible to enable users to view a movie 
production in a version with the Japanese audio. 
[0098] FIG. 1 8 shows an indirect reference with UTT. 
PL, describing in the same manner as FIG. 10. In the 
drawing, the PL information in the update kit has Clip 
Entry and Audio Entry. The arrows rfl, rf2, and rf3 in the 
drawing indicate the specifications of playback sections 
with Clip Entries. The arrows pfl, pf2, and pf3 in the 
drawing indicate the specifications of playback sections 
with Audio Entries. In other words, each of pieces of 
CELL information constituting the PL information in FIG. 
18 specifies two playback sections in the two AV 
streams. Because one piece of CELL information spec- 
ifies two playback sections, the PL information is able 
to define a playback path that is made up of a bundle of 
playback sections that are a playback section on the 
BD-ROM and a playback section in the HD. Thus, the 
description of the update kit stored in the local HD 12 is 
completed. 

[0099] The letter "U" is used in the file names of AV 
streams, the stream management information, and the 
PL information in an update kit, namely "UXX. M2TS'\ 
"UXX. CLPI", "UYY. PL", merely for convenience sake 
and for the purpose of distinguishing the AV streams, 
the stream management information, and the PL infor- 
mation in the update kit from those on the BD-ROM. In 
actuality, AV streams, the stream management informa- 
tion, and the PL information in an update kit have the 
file names that are the same as the ones on the 
BD-ROM. The data on the update kit and the data on 
the BD-ROM are brought into correspondence with 
each other with the use of the file names. To bring an 
AV stream recorded on the BD-ROM (an optical disc) 
and an AV stream in an HD (a secondary recording me- 
dium) into correspondence means (i) to bring them into 
correspondence with the use of PL information included 
in the update kit and (ii) to bring them into correspond- 
ence with the use of sameness between the file names 
of the files included in an update kit and the file names 
of the files recorded on the optical disc. 
[0100] The following describes the demultiplexing 
process performed by the demultiplexer 14 in a case 
where an AV stream in an update kit is read. The demul- 
tiplexing process performed by the demultiplexer 14 is 
to take PES packets, which are the payloads, out of TS 
packets constituting an AV stream that has been read 
from an HD, to then take the main-body data, which is 
the payload, out of the PES packets, and to output the- 
main-body data to the audio decoder 6, according to the 
time stamp attached to each TS packet. The demulti- 
plexing processing is performed by the demultiplexer 1 4 
with reference to a time stamp, such as PCR (Program 
Clock Reference) or ATS (Arrival Time Stamp), that is 
attached to each TS packet and the offsets included in 



the stream management information. When a clock in- 
side the playback apparatus reaches the time obtained 
by adding an offset to the time indicated by a time stamp 
on a TS packet, the demultiplexer 14 demultiplexes the 

5 TS packet, as described above. The time obtained by 
adding the offset to the time indicated by the time stamp 
is the same as the time obtained by adding the values 
of the times stamps on the TS packets read from 
BD-ROM. Accordingly, as a result of the processing per- 

10 formed by the demultiplexer 1 4 described above, the de- 
multiplexing of the TS packets read from the BD-ROM 
are in synchronization with the demultiplexing of the TS 
packets read from the HD. 

[0101] The following describes the synchronization 

15 processing performed by the audio decoder 6 in the 
case where the audio stream in the update kit is read 
from the local HD 12. when decoding audio frames read 
from a BD-ROM, the audio decoder 6 refers to PTSs 
(Presentation Time Stamps) attached to PES packets. 

20 That is to say, when the clock inside the playback appa- 
ratus reaches the time indicated by a PTS on a PES 
packet, the audio decoder 6 decodes the audio frames. 
On the other hand, when decoding audio frames read 
from the HD, the audio decoder 6 refers to PTSs (Pres- 

25 entation Time Stamps) attached to PES packets and the 
offsets in the stream management information. That is 
to say, when the clock inside the playback apparatus 
reaches the time obtained by adding an offset to the PTS 
attached to a PES packet, the audio decoder 6 decodes 

30 the audio frames. The time obtained by adding an offset 
to the time indicated by a PTS is substantially the same 
as the time indicated by a PTS attached to the video 
packet read from the BD-ROM. Accordingly, as a result 
of the processing performed by the audio decoder 6 de- 

35 scribed above, the playback outputs for the video 
frames read from the BD-ROM are in synchronization 
with the playback outputs for the audio frames read from 
the HD. The synchronization between the audio and the 
image is maintained due to the processing performed 

^0 by the demultiplexer 14 and the audio decoder 6 de- 
scribed above. 

[0102] The data is read from the BD-ROM and from 
the HD in units of ACCESS UNITs; however, the data is 
supplied from the demultiplexer 3 and from the demul- 

45 tiplexer 1 4 to the audio decoder 6, with no regard to AC- 
CESS UNITS. The reason is because the demultiplex- 
ing processing performed by the demultiplexer 3 and the 
demultiplexer 14 is to convert an ACCESS UNIT which 
is a TS packet sequence into a PES packet sequence 

50 and to convert them into audio frames and video frames; 
therefore, the data is supplied to the audio decoder 6 in 
units of frames that are included in each PES packet or 
each TS packet. Since PES packets and TS packets are 
the units of processing, when a part of an audio frame 

55 is included in a PES packet, the included part is output- 
ted to the audio decoder 6. When a plurality of audio 
frames are included in a PES packet, the plurality of au- 
dio frames are supplied to the audio decoder 6. The au- 



12 



23 



EP 1 553 769 A1 



24 



dio decoder 6 first stores those supplied audio frames 
or part of an audio frame into a built-in memory within 
the audio decoder 6 and then processes them. There 
would be a problem with the case where an audio frame 
is divided into portions and stored into a plurality of AC- 
CESS UNITS. The following discussion is based on an 
assumption that the first half of an audio frame is stored 
in a TS packet sequence constituting an ACCESS UNIT 
and the second half of the audio frame is stored in a TS 
packet sequence constituting the following ACCESS 
UNIT 

[0103] It is not rare that one audio frame is divided 
into portions and stored into a plurality of access UNITS. 
During the demultiplexing process onto AV streams, this 
could'happen on a regular basis. The reason for this is 
that since the data size of a payload of a PES packet is 
a non-integer multiple of the data size of an audio frame, 
there is always some part of audio frame that cannot fit 
into one TS packet or one PES packet. 
[0104] The following discusses the case where an au- 
dio switching processing is performed due to an update 
of SPRM(1), after the PES packet in which the first half 
of the audio frame is stored is demultiplexed and out- 
putted to the audio decoder 6, but before the PES packet 
in. which the second half of the audio frame is stored is 
demultiplexed. In such a case, to the audio decoder 6, 
afterthe first half of the audio frame is supplied, another 
audio frame from another audio stream is to be supplied. 
Although the audio decoder 6 has obtained the first half, 
the audio decoder 6 is not able to obtain the second 
half ; therefore, the audio decoder 6 is not able to prop- 
erly perform the decoding, and there is a possibility that 
the user experiences an unpleasant noise such as 
"thunk". In order to prevent this from occurring, it is nec- 
essary to employ a mute processing on the playback 
output from the audio decoder 6 for a short period of 
time after the audio is switched. As a result of this mute 
processing, although there will be a little "no-sound" pe- 
riod immediately after the audio is switched, it becomes 
possible to freely switch audio, for example, from the 
audio on the BD-ROM to the audio on HD, or from the 
audio on the HD to the audio on the BD-ROM. 
[0105] At last, the following describes more in detail 
the control procedure performed by the control unit 16 
of the present embodiment. 

[0106] When a BD-ROM is mounted to the playback 
apparatus 200, the control unit 16 reads a volume label 
from the BD-ROM and specifies a directory that match- 
es the read volume label among a plurality of directories 
in the local HD 12. The processing after that is per- 
formed on a basis that the files in the specified directory 
represent an update kit. The processing is realized by 
having a computer execute the processing procedure 
shown in the flow chart in FIG. 19. 
[0107] The flow chart forms a loop processing in 
which the processing from Steps S2 through S16 is re- 
peated for each of the CELLS belonging to the PL #x. 
Now, the CELL being the processing target will be re- 



ferred to as "CELL #y" which is a CELL at a y'th position 
in a PL. To be specific, the PL information #x is read into 
the memory (Step S1). The first CELL of the PL infor- 
mation #x is set as the CELL #y, and the last CELL of 
5 the PL information #x is set as the CELL #z (Step S2). 
Subsequently, the ACCESS UNITs belonging to the 
CELL #y is read from the BD-ROM and from the local 
HD 1 2 in parallel , and the video decoder 4 and the audio 
decoder 6 are instructed to decode the ACCESS UNITS 
(Step S3 to Step S12). When all the ACCESS UNITS'in 
the CELL have been decoded (Step S11: YES), it is 
judged whether the CELL #y has reached the CELL #z 
(Step S15), and the next CELL is set as CELL #y (Step 
S16). 

[0108] Among steps from S3 to S16, Steps S4 
through S12 represent a loop processing for reading 
each of the ACCESS UNITs belonging to the CELL #y 
from the BD-ROM and from the local HD 12. In this loop 
processing, the ACCESS UNIT to be a reading target 
will be referred to as "ACCESS UNIT #u" which is an 
ACCESS UNIT at a u'th position in an AV stream. In Step 
S3, priortothe loop processing in Steps S4 through S12, 
the ACCESS UNITs that are in the AV streams on the 
BD-ROM and in the HD and each include the In point 
video frame of the CELL #y are set as the ACCESS 
UNITs #u. 

[0109] The loop processing in Steps S4 through S12 
is to repeat the processing as follows: to read the AC- 
CESS UNITs #u from the BD-ROM and from the HD into 
the BD buffer 2 and into the HD buffer 13, respectively 
(Step S4), and to input the video frames constituting 
each ACCESS UNIT #u to the decoder (Step S5), and 
after Steps S6 and S7, to input the audio frames consti- 
tuting each ACCESS UNIT #u to the decoder (Step S8 
through Step S10). 

[0110] The reading of an ACCESS UNIT from the 
BD-ROM and the reading of an ACCESS UNIT from the 
HD do not have to be performed at the same time. The 
reading from one of them may be earlier or later than 
the reading from the other. The reason for this is that (i) 
since the ACCESS UNITs read from the BD-ROM and 
from the HD are once stored in the BD buffer 2 and the 
HD buffer 13 so that the speed is adjusted, and (ii) the 
demultiplexing processing performed by the demulti- 
plexer 3 and the demultiplexer 14, and the decoding 
processing performed by the video decoder 4 and the 
audio decoder 6 are performed in synchronization. 
[0111] When data is read from the BD-ROM to the BD 
buffer 2, the control unit 16 monitors the amount of the 
data stored in the BD buffer 2 so that when the amount 
of the data stored is insufficient, more ACCESS UNITS 
are read from the BD-ROM to the BD buffer 2 to avoid 
the insufficiency. Also for the HD, the reading is control- 
led in accordance with the amount of the data stored in 
the buffer 

[0112] The audio switching processing performed in 
Steps S8 through S10 is to, in accordance with the audio 
setting from the user, input, to the audio decoder 6, the 
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audio frames in the ACCESS UNIT having been read 
into the BD buffer 2 (Step S9), or to input the audio 
frames in the ACCESS UNIT having been read into the 
HD buffer 13 (Step S1 0) . The variable "Audio #v" in the 
drawing represents the audio set in SPRM (1) by the 
user. With regard to the variable "Audio #v", in the case 
where the user performs an operation for switching the 
audio (Step S7: YES), SPRM(1) is updated (Step S13). 
[01 13] In the case where the variable "Audio #v" indi- 
cates an audio stream on the BD-ROM side (Step S8: 
YES), among the audio frames in the ACCESS UNIT 
having been read into the BD buffer 2, the audio frame 
that corresponds to the variable "Audio #v" is inputted 
to the decoder (Step S9). In the case where the variable 
"Audio #v" indicates an audio stream on the local HD 1 2 
side (Step S8: NO), the audio frames in the ACCESS 
UNIT in the HD buffer is inputted to the decoder (Step 
S10). 

[0114] In Step S11, it is judged whether the condition 
for ending the loop processing is met. In the case where 
the ACCESS UNIT #u includes the Out point video 
frame of the CELL (Step S1 1 : YES), the loop processing 
will be repeated. When the requirement in this step is 
not met, the next ACCESS UNIT in the AV stream is set 
as the ACCESS UNITtfu (Step S1 2), and the procedure 
returns to Step S4 . Step S15 is a judgment step which 
is to be executed in a case where the processing in 
Steps S3 through S12 is repeated for ACCESS UNITs 
belonging to one piece of CELL information, In Step 
S1 5. it is judged whether or not the C ELL information #y 
being the current processing target is the last CELL in- 
formation #z. In the case where the CELL information 
fly being the current processing target is not CELL #z, 
the next CELL is set as the CELL #y (Step S16). Then, 
the procedure advances to Step S3 so that the process- 
ing in Steps S3 through S15 is performed on the AC- 
CESS UNITS belonging to the CELL #y. 
[0115] FIG. 20 shows the reading process in Steps 
S4 through S11. In the drawing, the ACCESS UNITS 
#1 00 are read from the BD-ROM and from the local HD 
1 2 into the BD buffer 2 and into the HD buffer 1 3 in Step 
S4. The switch 1 5 outputs the ACCESS UNIT # 1 00 from 
the BD buffer 2 to the audio decoder 6 according to the 
judgment in Step S8. The switch 15 switches between 

(a) outputting the audio frames in the ACCESS UNIT 
#100 from the BD buffer 2 to the audio decoder 6 and 

(b) outputting the audio frames in the ACCESS UNIT 
/M00 from the HD buffer 13 to the audio decoder 6, ac- 
cording to the SPRM (1). 

[0116] FIG. 21 shows what kind of audio playback is 
achieved as a result of the output switching shown in 
FIG. 20. In the case where the switch 15 outputs the 
ACCESS UNIT from the BD-ROM to the audio decoder 
6, playback is achieved as shown on the left side of FIG. 
21 , i.e. the playback is accompanied by an English line 
"He had a person at one's nod". On the other hand, in 
the case where the switch 1 5 outputs the ACCESS UNIT 
from the HD to the audio decoder 6, playback is 



achieved as shown on the right side of FIG. 21 , i. e. the 
playback is accompanied by a Japanese dubbed audio 
"Kare wa hito o ago de tsukatte inf. 
[0117] As explained above, according to the present 
5 embodiment, ACCESS UNITs that are in one-to-one 
correspondence with each other are read in parallel 
from the BD-ROM and from the local HD 12, and the 
decoder is instructed to selectively play back one of 
these ACCESS UNITS, therefore, switching of the audio 
10 is realized. Creators of a movie production are able to, 
even after the movie production is distributed on a 
BD-ROM, supply additional audio to users by distribut- 
ing it via the WWW server 500. 
[0118] Further, since the update kit includes only ad- 
's ditional audio, even if a public circuit exists between the 
playback apparatus 200 and the WWW server 500, the 
time required for downloading the update kit is short. 
[0119] It should be noted that, in the first embodiment, 
a built-in HD inside the playback apparatus is used for 
20 storing the update kit; however, it is acceptable that the 
update kit is stored in a portable recording medium. 

SECOND EMBODIMENT 

25 [0120] The second embodiment is related to an im- 
provement for the case where a sub-image stream is 
added to an Av stream recorded on a BD-ROM. The fol- 
lowing describes a sub-image stream recorded on a 
BD-ROM and an update kit for realizing addition of a 

30 sub-image stream. On a BD-ROM, a sub-image stream 
is multiplexed with a video stream and an audio stream 
so as to constitute an AV stream, as shown in FIG. 6. 
FIG. 22 shows how an ACCESS UNIT is structured in 
an AV stream according to the second embodiment . 

35 The ACCESS UNITs according to the second embodi- 
ment each include a GOP and a sub-image unit. The 
leaders with broken lines th1 highlight the internal struc- 
ture of a sub-image unit in each ACCESS UNIT. A sub- 
image unit is made up of a header and run length image 

40 data . IN the drawing the leaders th2 highlight the inter- 
nal structure of the header. The header includes "the 
display starting time/the display ending time", of the run 
length image data on a PL playback temporal axis and 
"the display coordinates" on the display screen. 

45 [0121] The sub-image stream in an update kit is sup- 
plied to the playback apparatus as being stored in an 
AV stream. To be more specific, an AV stream in the 
update kit according to the present embodiment is for 
the purpose of adding a sub-image to the AV-stream re- 

50 corded on the BD-ROM. Like the first embodiment, the 
AV stream in the update kit is made up of ACCESS 
UNITs that are equal in number to the ACCESS UNITs 
in an AV stream in a BD-ROM package. Each ACCESS 
UNIT includes a sub-image unit but does not include a 

55 GOP 

[0122] FIG. 23 shows in comparison the substances 
of an ACCESS UNIT in a BD-ROM package (XXX. 
M2TS) and the substance of an ACCESS UNIT in an 
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update kit (UXX. TS), describing in the same manner as 
FIG. 14. The upper level of FIG. 23 is an ACCESS UNIT 
on the BD-ROM side. The lower level is an ACCESS 
UNIT on the update kit side. In the drawing, the AC- 
CESS UNITs #60, #1 00, and #1 20 are to be played back 5 
1 minute, 1 minute and 40 seconds, and 2 minutes after 
the start of the playback of the AV stream, respectively. 
(In this example, the playback time of one ACCESS 
UNIT is approximated to one second). 
[0123] As we focus on the ACCESS UNITS, the AC- 10 
CESS UNIT #100 on the BD-ROM side includes a GOP 
to be played back at 1 minute and 40 seconds and a 
sub-image unit to be read at that time. On the other 
hand, the ACCESS UNIT #100 on the update kit side 
includes a sub-image unit to be played back at 1 minute '5 
and 40 seconds. 

[0124] Because of an arrangement wherein the AV 
stream in the update kit includes ACCESS UNITs which 
are equal in number to the ACCESS UNITS in the AV 
stream recorded on the BD-ROM, and wherein the AC- 20 
CESS UNITs in the AV stream in the update kit includes 
a sub-image unit having the equal time length to the sub- 
image unit recorded on the BD-ROM, the ACCESS 
UNITs in the AV stream recorded on the BD-ROM are 
in one-to-one correspondence with the ACCESS UNITs 25 
in the AV stream in the update kit. Due to this one-to- 
one correspondence, it is possible to achieve the switch- 
ing of the subtitles with time accuracy of approximately 
1.0 second. Thus, the description of the AV stream in 
the update kit is completed. The following describes the 30 
PL information in the update kit. 
[01 25] The PL information is supplied from a Website 
along with an AV stream having only sub-image and the 
stream management information for this AV stream. 
FIG. 24 shows the internal structure of PL information 35 
included in the update kit according to the second em- 
bodiment. The improvement peculiar to the present em- 
bodiment lies in a Subtitle Table within each piece of 
CELL information in the PL information. A Subtitle Table 
is made up of a plurality of Subtitle Entries (Subtitle En- 40 
tries #1 to #n) and the number of the Subtitle Entries 
(Number). 

[0126] The "Subtitle Table" is management informa- 
tion for a subtitle to be played back in synchronization 
with the playlist and is made up of a plurality of pieces 
of language information (Languages #1 to #k) and the 
number of the languages (Number) . In the case where 
the playlist corresponds to the English-language area, 
the Japanese-language area, and the Chinese-lan- 
guage area, pieces of language information for the three so 
languages are described in the "Subtitle Table". 
[01 27] Each piece of language information is made up 
of (i) information about to what language the piece of 
language information corresponds (Lang.), (ii) the posi- 
tion of the AV stream that corresponds to the sub-image 55 
(Storage Name), (iii) a plurality of pieces of speech in- 
formation written in the language (Speeches #1 to #j) 
and (iv) the number of the pieces of speech information 



(Number). The pieces of speech information (Speeches 
#1 to #j) are information related to speeches that appear 
during the playback of the playlist. In the case where 
there are five speeches during a playback of a CELL, a 
piece of speech information is written for each of the five 
speeches. FIG. 25 shows the speech information. As 
shown in the drawing, each piece of speech information 
(Speeches #1 to #j) includes the name of the AV stream, 
"AVStream Name" to which a sub-image unit in which 
the line in the speech is written belongs, "Stream ID" 
indicating a sub-image stream to which the sub-image 
unit belongs in the AV stream , "In point information" in- 
dicating a playback starting time of the sub-image unit, 
"Out point information" indicating a playback ending 
time of the sub-image unit, and "Position information" 
indicating the display coordinates. of the sub-image unit. 
[0128] Above is the description of the update kit writ- 
ten into the local HD 12. FIG. 26 shows the internal 
structure of the playback apparatus of the second em- 
bodiment. The following describes the constituent ele- 
ments that are related to the improvement portions of 
the playback apparatus according to the present em- 
bodiment, namely the download unit 11, the HD buffer 
13 , the switch 17 , the image decoder 7, and the control 
unit 16. 

[0129] The download unit 11 according to the second 
embodiment downloads an update kit for upgrading the 
sub-image from the WWW server 500 and writes the up- 
date kit into the local HD 12. 

[0130] Into the HD buffer 13 according to the second 
embodiment, one of the ACCESS UNITs constituting the 
AV stream recorded on the HD is read, every time one 
of the ACCESS UNITS constituting the AV stream re- 
corded on a BD-ROM is read into the BD buffer 2. 
[0131] The demultiplexer 14 demultiplexes the AC- 
CESS UNIT that is in an MPEG-TS format and has been 
read into the HD buffer 1 3 so as to obtain the sub-image 
before being multiplexed. 

[0132] The switch 17 outputs, to the image decoder 
7, one of the sub-image unit obtained through the de- 
multiplexing process performed by the demultiplexer 3 
and the sub-image unit obtained through the demulti- 
plexing process performed by the demultiplexer 14. 
Thus, the explanation on the improvement of the play- 
back apparatus according to the present embodiment is 
completed. The output switching performed by the 
switch 17 is based on SPRM(2), which represents the 
sub-image stream number. 

[0133] When decoding the sub-image unit read from 
the BD-ROM, the image decoder 7 refers to the display 
starting time attached to the header of the sub-image 
unit. That is to say, when the clock inside the playback 
apparatus reaches the time indicated by the display 
starting time in the header, the image decoder 7 de- 
codes the sub-image unit. On the other hand, when de- 
coding the sub-image unit read from the HD, the image 
decoder 7 refers to the display starting time attached to 
the header of the sub- image unit and an offset in the 
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streammanagement information. That is to say, when 
the clock inside the playback apparatus reaches the 
time obtained by adding the offset to the display starting 
time attached to the header of the sub-image unit, the 
image decoder 7 decodes the sub-image unit. The time 
obtained by adding an offset to the time indicated by the 
display starting time is substantially the same as the 
time indicated by the display starting time of the video 
packet read from the BD-ROM. Accordingly, as a result 
of the processing performed by the image decoder 9 de- 
scribed above, the playback output for the video frames 
read from the BD-ROM is in synchronization with the 
playback output for the sub-image units read from the 
HD. Further, when the clock inside the playback appa- 
ratus reaches a time obtained by adding an offset to the 
display ending time in the header, the image decoder 9 
makes the subtitle disappear. As a result of the process- 
ing described here, the subtitles are displayed and 
made disappear in synchronization with the playback of 
the video. 

[0134] The data is read from the BD-ROM and from 
the HD in units of ACCESS UNITs; however, the data is 
supplied from the demultiplexer 3 and from the demul- 
tiplexer 14 to the image decoder 9, with no regard to 
ACCESS UNITS. The reason is because the demulti- 
plexing processing performed by the demultiplexer 3 
and the demultiplexer 1 4 is to convert an ACCESS UNIT 
which is a TS packet sequence into a PES packet se- 
quence and to convert them into sub-image units and 
video frames; therefore, the data is supplied to the im- 
age decoder 9 in units that are included in PES packets 
or TS packets. Since the PES packets and the TS pack- 
ets are the units of processing, when a part of a sub- 
image unit is included in a PES packet, the included part 
is outputted to the image decoder 9. The reason for this 
is because a sub-image unit is a piece of run length im- 
age data, and the size of a sub-image unit is consider- 
ably larger than that of a PES packet, a sub-image unit 
is divided into portions and stored into a plurality of PES 
packets. 

[01 35] The image decoder 9 sequentially stores each 
of those supplied parts of the sub-image unit into a built- 
in memory within the image decoder. 9 and puts the sub- 
image unit together before decoding it. There would be 
a problem with the case where a sub-image unit is di- 
vided into portions and stored into a plurality of ACCESS 
UNITS. The following discussion is based on an as- 
sumption that the first half of a sub-image unit is stored 
in a TS packet sequence constituting an ACCESS UNIT 
and the second half of the sub-image unit is stored in a 
TS packet sequence constituting the following ACCESS 
UNIT 

[01 36] The following discusses the case where a sub- 
title switching processing is performed due to an update 
of SPRM(2), after the PES packet in which the first half 
of the sub-image unit is stored is demultiplexed and out- 
putted to the image decoder 9, but before the PES pack- 
et in which the second half of the sub-image unit is 



stored is demultiplexed. In such a case, to the image 
decoder 9, after the first half of the sub-image unit is 
supplied, another sub-image unit belonging to another 
sub- image stream is to be supplied. Although the image 

5 decoder 9 has obtained the first half, the image decoder 
9 is not able to obtain the second half; therefore, the 
image decoder 9 is not able to properly perform the de- 
coding, and there is a possibility that image decoder 9 
displays non-sense data. In order to prevent this from 

10 occurring, it is necessary to employ an erase processing 
on the playback output from the image decoder 9 for a 
short period of time after the subtitle is switched. As a 
result of this erase processing, although there will be a 
little "no-subtitle" period immediately after a switch to an 

'5 upgraded version, as soon as the following sub-image 
unit is stored in the memory within the image decoder 
9, the subtitle display is resumed. Accordingly, it be- 
comes possible to freely switch subtitles, for example, 
from the subtitle on the BD-ROM to the subtitle on HD, 

20 or from the subtitle on the HD to the subtitle on the 
BD-ROM. 

[0137] The control unit 1 6 in the present embodiment 
performs the playback processing of ACCESS UNITS 
according to the flow chart in FIG. 27. The flow chart 

25 forms a loop processing in which the processing from 
Steps S22 through S36 is repeated for each of the 
CELLS belonging to the PL #x. Now, the CELL being 
the processing target will be referred to as "CELL #y" 
which is a CELL at a y'th position in a PL. To be specific, 

30 the PL information #x is read into the memory (Step 
S21). The first CELL of the PL information #x is set as 
the CELL #y, and the last CELL of the PL information #x 
is set as the CELL #z (Step S22). Subsequently, the AC- 
CESS UNITS belonging to these CELLs are read from 

35 the BD-ROM and from the local HD 12 in parallel, and 
the image decoder 7 is instructed to decode the AC- 
CESS UNITS (Step S23 to Step S36). 
[0138] Among Steps from S23 to S36, Steps S24 
through S32 represent a loop processing for reading 

40 each of the ACCESS UNITs belonging to the CELL #y 
from the BD-ROM and from the local HD 12. In this loop 
processing, the ACCESS UNIT to be a reading target 
will be referred to as "ACCESS UNIT #u" which is an 
ACCESS UNIT at a u'th position in an AV stream. In Step 

45 S23, prior to the loop processing in steps. S24 through 
S32, the ACCESS UNITS that are in the AV streams on 
the BD-ROM and in the HD and each include the In point 
video frame of the CELL #y is set as the ACCESS 
UNITS #u. 

50 [01 39] The loop processing in Steps S24 through S32 
is to repeat the processing as follows: to read the AC- 
CESS UNITS #u from the BD-ROM and from THE HD 
into the BD buffer 2 and into the HD buffer 13 , respec- 
tively (Step S24), and after Step S27 and Step S37, to 

55 input the sub-image units constituting the ACCESS 
UNIT #u to the decoder (Steps S28 through S30). 
[0140] The subtitle switching process performed in 
Steps S28 through S30 is to input, to the image decoder 
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7, the sub-image units in the ACCESS UNIT having 
been read into the buffer, in accordance with SPRM (2). 
The "subtitle #v" in the drawing represents the subtitle 
language set in SPRM (2) by the user. In the case where 
the user performs an operation for switching the subti- 5 
ties (Step S27 : YES), SPRM(2) is updated (Step S33). 
[0141] In the case where the subtitle #v Indicates a 
sub-image stream on the BD-ROM side (Step S28 : 
YES), among the sub-image units in the ACCESS UNIT 
having been read into the BD buffer 2, the sub-image 10 
units that corresponds to the subtitle #v is inputted to 
the image decoder 7 (Step S29) . In the case where the 
subtitle #v indicates a sub-image stream on the local HD 
12 side (Step S28: NO), the sub-image units in the AC- 
CESS UNIT on the HD buffer side is inputted to the im- ^ 
age decoder 7 (Step S30). 

[01 42] In Step S31 , it is judged whether the condition 
for ending the loop processing is met. In the case where 
the ACCESS UNIT #u includes the Out point video 
frame of the CELL (Step S31 ; YES), the loop processing 20 
will be terminated. When the requirement in this step is 
not met, the next ACCESS UNIT in the Av stream is set 
as the ACCESS UNIT #u (Step S32), and the procedure 
returns to Step S24. Step S35 is a judgment step which 
is to be executed in a case where the processing in 25 
Steps S23 through S32 is repeated for ACCESS UNITs 
belonging to one piece of CELL information. In Step 
S35, it is judged whether or not the CELL information #y 
being the current processing target is the last CELL in- 
formation #z. In the case where the CELL information 30 
fly being the current processing target is not CELL #z, 
the next CELL is set as the CELL #y (Step S36). Then, 
the procedure advances to Step S23 so that the 
processing in Steps S23 through S35 is performed on 
the ACCESS UNIT #u belonging to the CELL #y. 35 
[01 43] FIG. 28 shows the process of parallel reading 
performed by the control unit 16 to read from the 
BD-ROM and from the HD. In the drawing, the ACCESS 
UNIT /MOO is read from the BD-ROM and from the local 
HD 12 into the BD buffer 2 and into the HD buffer 13, *o 
respectively, in Step S4. The switch 17 switches be- 
tween (a) outputting the sub-image unit in the ACCESS 
UNIT #100 from the BD buffer 2 to the decoder and (b) 
outputting the sub-image unit in the ACCESS UNIT 
#100 from the HD buffer 13 to the decoder, according ^ 
to the SPRM (2). 

[0144] FIG. 29 shows what kind of subtitle display is 
achieved as a result of the output switching shown in 
FIG. 28. In the case where the switch 17 outputs the 
ACCESS UNIT #1 00 from the BD-ROM side to the audio 50 
decoder 6, playback is achieved as shown on the left 
side of FIG. 29, i. e. the playback is performed so that 
an English subtitle "Run after you" is combined with the 
moving pictures. On the other hand, in the case where 
the switch 1 7 outputs the ACCESS UNIT #100 from the 55 
HD side to the audio decoder 6, playback is achieved 
as shown on the right side of FIG. 29, i. e. the playback 
is performed so that the Japanese subtitle is combined 



with the moving pictures. 

[0145] As explained above, according to the present 
embodiment, ACCESS UNITs that are in one-to-one 
correspondence with each other are read in parallel 
from the BD-ROM and from the local HD 12, and the 
decoder is instructed to selectively play back one of 
these ACCESS UNITS, therefore, switching of the sub- 
titles is realized. Creators of a movie production are able 
to, even after the movie production is distributed on a 
BD-ROM, supply additional subtitles to users by distrib- 
uting them via the WWW server 500. 
[0146] It is necessary to read ACCESS UNITS from 
the BD-ROM and from the HD in parallel, in the case 
where the size of the sub-image stream in the update 
kit is large. Such parallel reading is not necessary in the 
case where the size of the sub-image stream in the up- 
date kit is small. For example, when the subtitle is text 
data and the size of the subtitle is as small as some kil- 
obytes, it is acceptable to read the text data from the 
HD, before data is read from the BD-ROM, so that the 
subtitle is stored in the memory within the playback ap- 
paratus, and then the subtitle image is rendered. 

THIRD EMBODIMENT 

[0147] The third embodiment relates to an improve- 
ment for the case where after a piece of video data hav- 
ing multi angle sections is distributed as being recorded 
on a BD-ROM, another piece of video data for views 
from another angle is distributed, First of all, the follow- 
ing describes in detail the BD-ROM and an update kit 
according to the present embodiment. 
[0148] First of all, the following describes the 
BD-ROM according to the present embodiment. FIG. 
30A shows the internal structure of the BD-ROM accord- 
ing to the third embodiment. In the drawing, the AV 
stream #1, the multi angle section, the AV stream #4, 
the stream management information #1 #2, #3, #4, and 
the PL information #1, #2, #3, are recorded on the 
BD-ROM. 

[0149] To explain more specifically, the AV stream #1 
and the AV stream #4 are the same as the AV stream 
described in the first embodiment. The multi angle sec- 
tion between the AV stream #1 and the AV stream #4 is 
made up of two AV streams such as the AV stream #2 
and the AV stream #3. 

[0150] The AV stream #2 and the AV stream #3 are 
pieces of video data that have been taken from two dif- 
ferent angles. In such a case, the AV stream #2 and the 
AV stream #3 can be each divided into three ILVUs (In- 
terLeaVe Units), as follows: 

the AV Stream #2: ILVU (2-1), ILVU (2-2), and ILVU 
(2-3) 

the AV Stream #3: ILVU (3-1), ILVU (3-2), and ILVU 
(3-3) 

[0151] Here, in the expression "ILVU (XX-YY)", "XX" 
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denotes an AV stream to which the ILVU belongs, and 
"YY" denotes the order in which the ILVU is placed in 
the AV stream. These ILVUs are recorded on a disc with 
a numbering system as follows: 

ILVU (2-1), ILVU (3-1), ILVU (2-2), ILVU (3-2), ILVU 
(2-3), ILVU (3-3) 

[0152] The ILVUs constituting the VOB #1 and the IL- 
VUs constituting the VOB #2 alternately appear. Accord- 
ingly, for example, when ILVU (2-1) and ILVU (3-1) are 
read together, the video decoder 4 is able to selectively 
decode one of ILVU (2-1) and ILVU (3-1). With this ar- 
rangement, it is possible to realize switching of angles 
according to a user operation. 

[0153] The following describes how the ILVUs de- 
scribed above are managed on the BD-ROM. FIG. 31 
shows how the positions of the ILVUs constituting the 
multi angle section shown in FIG. 30 are managed. Each 
of the ILVUs constituting an AV stream is managed, like 
the extents constituting a file, by describing the starting 
address and the length in the file management informa- 
tion. The lower level of the drawing shows at which ad- 
dress in the BD-ROM each ILVU is recorded. The ILVUs 
(3-1) and (3-2) which constitute the AV stream #3 are 
recorded at the addresses 64 and 1280 and have run 
lengths of 1 024 and 880, respectively. These addresses 
and run lengths are written in the management informa- 
tion for the AV stream #3, which is indicated as kj 3. The 
ILVus (2-1) (2-2) and (2-3) which constitute the AV 
stream #2 are recorded at the addresses, 1 0, 1 088, and 
21 60 and have the run length of 54, 92 : and 200 respec- 
tively. These addresses and the run lengths are written 
in the management information for the AV stream #2, 
which is indicated as kj2. The recording addresses of 
ILVUs constituting AV streams are written into pieces of 
file management information, so that each piece of file 
management information corresponds to a different one 
of the AV streams; therefore, even if the AV stream #2 
and the AV stream #3 constitute a multi angle section 
on a BD-ROM, they are treated as different files. Thus, 
the description of the multi angle section on the 
BD-ROM is completed. 

[0154] The following describes the stream manage- 
ment information. FIG. 32 shows the structure of the 
stream management information according to the third 
embodiment. The stream management information 
here is different from the stream management informa- 
tion shown in FIG. 8 in that it includes ILVUMAP in ad- 
dition to the attribute and the TMAP. The ILVUMAP is 
made up of Entries #1 to tfn related to each ILVU and 
the LT number (Number) . In each ILVU Entry, the 
number of ACCESS UNITs belonging to the ILVU is writ- 
ten. By us ing the ILVU Entries along with the TMAP and 
the file management information, it is possible to easily 
cue ACCESS UNITS belonging to the ILVU. 
[0155] Thus, the description of the BD-ROM accord- 
ing to the present embodiment is completed. The follow- 



ing describes the AV stream included in the update kit. 
[0156] The AV stream included in the update kit ac- 
cording to the present embodiment (the AV stream #5 
in the drawing) is for forming an additional angle image. 
It is assumed that the BD-ROM according to the present 
embodiment is a video for views from a passenger train, 
and that the AV stream #2 is for a video image taken 
from the driver's seat, the AV stream #3 is for a video 
image taken from the windows provided on one of the 
sides of a compartment. The situation is that the AV 
stream #2 and the AV stream #3 are recorded on the 
BD-ROM, but, for some reasons, an arrangement is 
made so that the video image taken from the windows 
provided on the opposite side of the compartment is not 
recorded on the BD-ROM. In that situation, in order to 
distribute the video image taken from the opposite side 
to users, the update kit of the present embodiment is 
generated. 

[0157] As shown in FIG. 30B, the AV stream included 
in the update kit is recorded in the local HD 12, as being 
divided into a plurality of ILVUs. The AV stream #5 in the 
local HD 12 is to be read in units of ILVUs. 
[0158] The length of the playback time for the ILVUs 
(5-1) and (5-2), which are obtained by dividing UXX. 
M2TS, is equal to the length of the playback time of the 
ILVUs (1 -1 ), ( 1 -2), (2-1 ), and (2-2) which constitute XXX. 
M2TS. 

[01 59] The stream management information included 
in the update kit according to the present embodiment 
is management information for managing the AV stream 
in the HD. The internal structure is the same as the one 
shown in FIG. 32; therefore, the drawing thereof is omit- 
ted. 

[0160] The PL information included in the update kit 
according to the present embodiment is path informa- 
tion for treating the multi angle section recorded on the 
BD-ROM and the AV stream in the HD as one PL. FIG. 
33 shows the internal structure of the PL information ac- 
cording to the third embodiment. FIG . 33 is different from 
FIG. 1 7 in that, instead of the AV stream entries such as 
Stream ID, In, and Out, Angle Entries #1 to #n are in- 
cluded in each piece of CELL information. An Angle En- 
try is for defining a playback section in each of the AV 
streams that correspond to different angles. The arrow 
with a broken line ayl highlights the internal structure of 
an Angle Entry. As observed from this, an Angle Entry 
is made up of "AVStream Name" of the AV stream for 
the corresponding angle, "In point information" indicat- 
ing the starting point of the playback section in the AV 
stream, and "Out point information" indicating the end- 
ing point of the playback section in the AV stream. 
[0161] In order to treat the multi angle section record- 
ed on the BD-ROM and the AV stream in the HD as one 
PlayList, the Angle Entries in the PL information are set 
for the AV streams constituting the multi angle section 
on the BD-ROM and for the AV stream in the HD. To be 
more specific, the Angle Entry # 1 is set for the AV stream 
#2 for the multi angle section on the BD-ROM; the Angle 
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Entry #2 is set for the AV stream #3 for the multi angle 
section on the BD-ROM; and the Angle Entry #3 is set 
for the AV stream #5 for the update kit in the HD. 
[0162] FIG. 34 schematically shows indirect refer- 
ence with Angle Entries included in the PL information. 5 
[01 63] The arrows gy 1 and gy2 in the drawing indicate 
specification of playback sections in the AV streams on 
the BD-ROM with the Angle Entries #1 and #2. On the 
other hand, the arrow gy3 indicates specification of a 
playback section in the AV stream in the local HD 12 
with the Angle Entry #3. The bundle of playback sections 
is specified in the PL information. Since one piece of PL 
information specifies the playback sections in the multi 
angle section on the BD-ROM and the playback sec- 
tions in the local HD 12, when playback is performed, 
the playback apparatus reads, in parallel, ILVUs consti- 
tuting the multi angle section and the ILVUs constituting 
the AV stream on the BD-ROM. 
[0164] Thus, the description of the update kit accord- 
ing to the present embodiment is completed. The follow- 
ing describes the playback apparatus according to the 
present embodiment. FIG. 35 shows the internal struc- 
ture of the playback apparatus according to the third em- 
bodiment. The playback apparatus shown in this draw- 
ing is different in that it has a switch 18 in addition. 
[0165] The following describes the constituent ele- 
ments that are related to the improved portions of the 
playback apparatus of the present embodiment, name- 
ly, the download unit 11 , the HD buffer 13, the demulti- 
plexer 1 4 : the switch 1 8, and the video decoder 4. 
[01 66] The download unit 1 1 of the third embodiment 
downloads an update kit from the WWW server 500 so 
as to write the downloaded update kit to the local HD 
12, the update kit being for adding a new angle image 
to the multi angle section recorded on the BD-ROM. 
[0167] Into the HD buffer 13 of the third embodiment, 
one of the ILVUs constituting the AV stream recorded 
on the HD is read, every time one of the ILVUs consti- 
tuting the AV stream recorded on the BD-ROM is read 
into the BD buffer 2. 

[0168] The demultiplexer 14 demultiplexes the ILVUs 
that are in an MPEG-TS format and have been read into 
the HD buffer 13 so as to obtain the GOP before being 
multiplexed. 

[01 69] The switch 1 8 outputs, to the video decoder 4, 
one of the GOP obtained through the demultiplexing 
process performed by the demultiplexer 3 and the GOP 
obtained through the demultiplexing process performed 
by the demultiplexer 1 4. The output switching performed 
by the switch 18 is based on SPRM (3), which repre- 
sents the angle number. 

[0170] when decoding an ILVU read from the 
BD-ROM, the video decoder 4 refers to the PTS at- 
tached to the PES packet constituting the ILVU. That is 
to say, when the clock inside the playback apparatus 
reaches the time indicated by the PTS on the PES pack- 
et, the video decoder 4 decodes the ILVU. On the other 
hand, when decoding an ILVU read from the HD, the 



video decoder 4 refers to a PTS attached to the PES 
packet and an offset in the stream management infor- 
mation. That is to say, when the clock inside the play- 
back apparatus reaches the time obtained by adding the 
offset to the PTS attached to the PES packet, the video 
decoder 4 decodes the ILVU. The time obtained by add- 
ing an offset to the time indicated by a PTS is substan- 
tially the same as the time indicated by a PTS on the 
audio packet read from the BD-ROM. Accordingly, as a 
result of the processing performed by the video decoder 
4 above, the playback outputs for the audio frames read 
from the BD-ROM are in synchronization with the de- 
coding of the ILVUs read from the HD. 
[0171] Thus, the description of the improvement with 
the playback apparatus according to the. present em- 
bodiment is completed. The control unit 16 of the 
present embodiment performs the playback processing 
according to the flow chart in FIG. 36 so as to control 
the playback apparatus in such a manner as described 
above. 

[0172] The flow chart forms a loop processing in 
which the processing in steps S42 through S56 is re- 
peated for each of the CELLS belonging to the PL #x. 
Now, the piece of CELL information being the process- 
ing target will be referred to as "CELL information #y" 
which is a piece of CELL information at a y'th position 
in a PL. To be specific, the PL information #x is read into 
the memory (Step S41 ). The first CELL of the PL infor- 
mation #x is set as the CELL #y, and the last piece of 
CELL information of the PL information #x is set as the 
CELL information #z (Step S42). Subsequently, the IL- 
VUs belonging to the CELLs are read from the BD-ROM 
and from the local HD 12 in parallel, and the video de- 
coder 4 is instructed to decode the ILVUs (Steps S43 
through S56). 

[0173] Among Steps from S43 through S56, Steps 
S44 through S52 represent a loop processing for read- 
ing each of the ILVUs belonging to the CELLs #y from 
the BD-ROM and from the local HD 12 . In this loop 
processing, the ILVU to be a reading target will be re- 
ferred to as "ILVU #u" which is an ILVU at a u'th position 
in an AV stream. In Step S43, prior to the loop process- 
ing in Steps S44 through S52, the ILVUs that are in the 
AV streams on the BD-ROM and in the HD and each 
include the In point video frame of the CELL #y is set as 
the ILVUs #u. 

[0174] The loop processing in Steps S44 through S52 
is to repeat the processing as follows: to read the ILVUs 
#u from the BD-ROM and from the HD into the BD buffer 
2 and into the HD buffer 1 3 respectively, and to input the 
ACCESS UNITS constituting the ILVU in the buffers to 
the decoder (Steps S44 through S52), and after all of 
the ACCESS UNITs have been inputted, the processing 
advances to the next ILVU (Step S54). 
[0175] The ACCESS UNIT to be inputted to the video 
decoder 4 will be referred to as the ACCESS UNIT #k, 
which is an ACCESS UNIT at a k'th position in an ILVU. 
In the loop processing in Step S44 through S50, the first 
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ACCESS UNIT in the ILVU in the buffer is set as the 
ACCESS UNIT flu (Step S45), and thereafter every time 
the loop processing is repeated once, the next ACCESS 
UNIT in the ILVU is set as the ACCESS UNIT flk (Step 

552) . 

[0176] Among Steps S44 through S50, Steps S48 
through S50 represent the processing of inputting, to the 
decoder, ACCESS UNITS in the ILVU having read into 
the buffer, in accordance with an angle setting by the 
user. The angle #v in the drawing represents the angle 
set in SPRM (3) by the user. In the case where the user 
performs an operation for switching the angles (Step 
S47: YES), SPRM(3) is updated (Step S53). 
[01 77] In the case where the angle #v indicates an an- 
gle on the BD-ROM side (Step S48; YES), among the 
ACCESS UNITs in the ILVU having been read into the 
BD buffer 2, the ACCESS UNIT that corresponds to the 
angle flv is inputted to the decoder as the ACCESS 
UNIT flk (Step S49). In the case where the angle flv in- 
dicates an angle on the local HD 1 2 side (Step S48: NO) , 
the ACCESS UNIT #k in the ILVU in the HD buffer is 
inputted to the decoder (Step S50). 
[0178] In Step S51 , it is judged whether the condition 
for ending the loop processing is met. In the case where 
the ACCESS UNIT #k is not the last ACCESS UNIT in 
the ILVU flu (Step S51 : NO), the next ACCESS UNIT in 
the AV steam is set as the ACCESS UNIT flk (Step S52), 
and the procedure returns to Step S47. In the case 
where the ACCESS UNIT #k is the last ACCESS UNIT 
in the ILVU #u, it is judged whether or not the ILVU #u 
includes the Out point video frame of the CELL (Step 

553) . If the ILVU flu does not include the Out point video 
frame of the CELL, the next ILVU in the CELL is set as 
the ILVU #u (Step S54), and the procedure advances to 
Step S44. If the ILVU flu includes the Out point video 
frame of the CELL, Step S55 is executed. In Step S55, 
the CELL information fly being the current processing 
target is the last CELL information flz. In the case where 
the CELL information fly being the current processing 
target is not CELL flz, the next CELL is set as the CELL 
fly (Step S56). Then, the procedure advances to Step 
S43 so that the processing in Steps S43 through S55 is 
performed on the ILVUs belonging to the CELL fly. In 
the case where an operation for stopping the playback 
is performed, the processing in this flow chart is termi- 
nated (Step S53: YES). 

[0179] FIG. 37 shows the process of parallel reading 
performed by the switch 18 to read from the BD-ROM 
and from the HD. The ILVUs (2-2) and (3-2) in the draw- 
ing are read from the BD-ROM into the BD buffer 2 in 
Step S44. The ILVU (5-2) in the drawing is read from the 
HD into the HD buffer 13 in Step S44. The switch 18 
selectively outputs, to the video decoder 4, one of (a) 
the ILVUs (2-2) and (3-2) on the BD buffer 2 side and 
(b) ILVU (5-2) on the BD buffer 13 side. 
[0180] FIG. 38 shows what kind of video display is 
achieved as a result of the output switching shown in 
FIG. 37. In the case where the switch 18 outputs the 



ILVU (3-2) on the BD-ROM side to the video decoder 4, 
playback is achieved as shown on the left side of FIG. 
28, i.e. the playback is performed so that the video im- 
age taken from the driver's seat of the train is shown. 

5 On the other hand, in the case where the switch 1 7 out- 
puts the ILVU (5-2) on the HD side to the video decoder 
4, playback is achieved as shown on the right side of 
FIG. 38, i. e. the playback is performed so that the video 
image taken from a side of the train with windows is 

10 shown. 

[0181] As explained above, according to the present 
embodiment, in the case where the movie production 
recorded on a BD-ROM is a multi-angle type movie pro- 
duction, it is possible to add new scenes and to further 
15 enrich the content of the movie production. 

FOURTH EMBODIMENT 

[0182] In the first embodiment, reading of ACCESS 

20 UNITs from the BD-ROM is performed in parallel with 
reading of ACCESS UNITs from the local HD 12. In the 
fourth embodiment, however, streaming playback is 
performed in parallel with reading of ACCESS UNITS 
from a BD-ROM. FIG. 39 shows a home theater system 

25 according to the fourth embodiment. 

[0183] The system shown in the drawing is different 
in that it has the home server 600. in the drawing, the 
playback apparatus 200 downloads only the stream 
management information and the PL information from 

30 within an update kit. The home server 600 downloads 
the AV streams from within the update kit. Here, the 
home server 600 is a device for writing a content that 
has been distributed or broadcasted into a built-in HD 
provided inside the home server 600. A distributed AV 

35 stream is downloaded by the home server 600 and writ- 
ten into the built-in HD. 

[0184] The playback apparatus 200 according to the 
present embodiment receives the supply of the AV 
stream out of the update kit from the home server 600. 

40 Thus, the general structure of the home theater system 
of the present embodiment is completed. 
[01 85] In order to obtain ACC ESS UN ITs from the out- 
side of the playback apparatus when a streaming play- 
back is performed, the stream management information 

45 and the PL information in the update kit are improved 
as shown in FIGs. 40 and 41 . The improvement of the 
stream management information lies in that an "URI" in- 
dicating the location from which the AV stream being the 
target of the streaming playback is to be obtained is de- 

50 scribed in the Audio attribute information. That is to say, 
among information included in the Audio attribute infor- 
mation, an "URI" of the location from which the AV 
stream is to be obtained is written, instead of an 
"AVStream Name" and an "Audiostream ID" . 

55 [0186] The improvement of the PL information lies in 
that the "URI" of the location from which the AV Stream 
being the target of the streaming playback is to be ob- 
tained is written in an Audio Entry. That is to say, among 
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information included in an Audio Entry within the PL in- 
formation, the URI of the location from which the AV 
stream is to be obtained is written, instead of an 
"AVstream Name" and an "Audiostream ID". 
[0187] The playback apparatus 200 downloads the 5 
stream management information and the PL information 
from within an update kit and writes the URI of the home 
server 600 into the stream management information and 
the PL information . Through this process, the prepara- 
tion has been done for taking out AV streams from the 
home server 600. 

[0188] Thus, the description of the improvements of 
the update kit according to the present embodiment is 
completed. The following describes the improvement on 
the playback apparatus. FIG. 42 shows the internal 
structure of the playback apparatus according to the 
fourth embodiment. The improvement on the playback 
apparatus mainly lies in that a streaming buffer 19 is 
added. The improvement on playback control per- 
formed by the control unit 16 is shown in the flow chart 
in FIG. 43. In this flow chart, the processing in Steps 
S1 00 through S1 02 has been newly added. 
[0189] In Step S1 00, reading of ACCESS UNITs from 
the www server 500 is performed prior to the reading 
from the BD-ROM. The reason for this is because it is 
desirable to supply ACCESS UNITs to the streaming 
buffer 19 prior to the reading from the BD-ROM, since 
it takes a long time to obtain ACCESS UNITs from the 
WWW server 500, The procedure waits until a sufficient 
amount of ACCESS UNITs are stored in the streaming 
buffer 1 9 (Step S1 01 ), and when a sufficient amount has 
been stored, reading of the ACCESS UNITs from the 
BD-ROM into the BD buffer 2 is started (step S102). 
[0190] As soon as a sufficient amount of ACCESS 
UNITs has been stored in the BD buffer 2 and in the 
streaming buffer 1 9, the GOPs and the audio frames in- 
cluded in the ACCESS UNITs are inputted to the decod- 
er. At this time, audio frames are selectively played back 
in accordance with the user's operation indicated by 
SPRM (1) (Steps S5 through S17). 
[0191] As explained above, according to the present 
embodiment, it is possible to selectively play back either 
the audio stream downloaded into another device in a 
home network or the audio stream recorded on a 
BD-ROM; therefore, it is possible to more freely choose 
where the update kit should be located. 
[0192] It should be noted that it is acceptable to per- 
form the streaming playback with the supply of data from 
a distribution server, instead of from a device owned by 
the user such as the home server 600. However, since 
distribution via the Internet is in general at a low speed, 
it is desirable to read a sufficient amount of ACCESS 
UNITs into a stream file prior to the reading from a 
BD-ROM. 

FIFTH EMBODIMENT 

[01 93] The fifth embodiment is related to an improve- 



ment for having a playback apparatus play back a new 
version of the movie production recorded on a BD-ROM 
with the use of a dynamic scenario being downloaded. 
[0194] With regard to distribution of movie produc- 
tions via optical discs, there are high demands from us- 
ers that they wish to view world-wide successful movie 
productions at home as early as possible. Creators of 
movie productions assume the duties of creating movie 
productions with hard schedules. In recent years, the 
movie industries have a tendency of enhancing the add- 
ed value by recording commentaries by directors and 
actors and the images for "the making of", the outtakes, 
and the unreleased scenes on the BD-ROMs besides 
the main bodies of the movie productions themselves. 
To create the subtitles and the dubbed audio for these 
additional features makes the hard schedules even 
harder 

[0195] In order to solve the problem, a dynamic sce- 
nario is downloaded in the present embodiment. 
[0196] A dynamic scenario is a program that shows 
the playback control procedure for anAV stream with the 
use of PL information. A dynamic scenario is defined in 
the fourth layer in a layer model of the control of a play- 
back apparatus. FIG. 44 shows the fourth layer in the 
layer model . In the drawing, one normal mode and two 
enhanced modes are written in the fourth layer. The one 
normal mode is a playback mode in a DVD-like playback 
environment and is referred to as a Movie mode. The 
first one of the two enhanced modes is a playback mode 
mainly for a Java virtual machine and is referred to as 
a Java mode. The second one of the two enhanced 
modes is a playback mode mainly for a browser and is 
referred to as a Browser mode. 
[01 97] Since there are the three modes, i.e. the Movie 
mode, the Java mode, and the Browser mode, in the 
fourth layer, it is enough if a dynamic scenario is written 
so that it can be executed in only one of the modes. 
When it is desired that the control procedure be written 
with commands that are similar to those for a DVD play- 
er, it would be good that the playback control procedure 
in the Movie mode is written. This way, it is possible to 
have a playback apparatus perform a playback control 
that is similar to that of an existing DVD playback appa- 
ratus. When it is desired that the control procedure be 
written in a page description language, it would be good 
that the playback control procedure in the Browser 
mode is written. This way, it is possible to describe play- 
back procedures for accessing a site in a network and 
for downloading a file. A dynamic scenario in the Java 
mode is ZZZ. CLASS, and a dynamic scenario in the 
Browser mode is ZZZ.HTM, which are shown in FIG. 44. 
A dynamic scenario in the Movie mode is ZZZ. MOVIE. 
In the case where a movie production constituted with 
three PLs is recorded on a BD-ROM, an example of how 
a dynamic scenario for this is described is shown in FIG. 
45A. The dynamic scenario in the drawing is in the Java 
mode and written in a Java language and is referred to 
as a Java object. Since description can be made in the 
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Java language, it is possible to write the playback con- 
trol procedure in the Java object using programming 
with the use of IF sentences and the like. "Play PL (XX, 
YY) N in the drawing denotes a function for playing back 
the PL specified by a first argument XX, starting from 5 
the position indicated by a second argument. In an ex- 
ample of writing a program shown in FIG. 45A, since 
there are three function calls such as PlayPL (PL #1, 
CELL #1), PlayPL (PL #2, CELL #1), and PlayPL (PL 
#3, CELL #1 ), the three PLs such as PL #1 , PL #2, and io 
PL #3 are sequentially played back so as to form the 
movie production. It should be noted that PL #1 , PL #2, 
and PL #3 denote not just pieces of PL information but 
the sets that are each made up of an AV stream, stream 
management information, and PL information. ^ 
[0198] Thus, the description of the BD-ROM accord- 
ing to the present embodiment is completed. The follow- 
ing describes an update kit according to the present em- 
bodiment. 

[01 99] An update kit according to the present embod- 20 
iment includes a dynamic scenario. This dynamic sce- 
nario is used in place of the dynamic scenario recorded 
on a BD-ROM. To be more specific, in the case where 
a new dynamic scenario exists in an update kit, this new 
dynamic scenario is used instead of the dynamic see- 25 
nario recorded on the BD-ROM. 
[0200] FIG. 45B shows a dynamic scenario to be used 
in place of the dynamic scenario shown in FIG. 45A. 
Such a dynamic scenario is written into a HD as being 
incorporated in an update kit. This update kit is for real- 30 
iztng a "language credit", which is to switch playback 
scenes depending on the language, and the update kit 
includes an additional PL, that is the PL #4, besides the 
dynamic scenario. This is a substitute image and is to 
be played back alternatively in place of the PL #2. 35 
[0201] The new dynamic scenario in the update kit re- 
alizes conditional playback which is to playback the PL 
#4 (Link(PL #4, CELL #1, 0)), if the language setting 
(SPRM (0)) on the playback apparatus is "Japanese" (if 
(SPRM(0)==Japanese)), and to play back the PL #2 40 
(Link(PL #2, CELL #1, 0)) if the language setting on the 
playback apparatus is some other language (else) . 
[0202] FIG. 46A shows the playback procedure with 
the dynamic scenario recorded on the BD-ROM. FIG. 
46B shows the playback procedure with the dynamic 45 
scenario included in the update kit. The arrows hb1 and 
hb2 in FIG. 46B symbolically shows conditional branch- 
ing with the dynamic scenario in the update kit. 
[0203] As apparent from the drawings, the dynamic 
scenario recorded on the BD-ROM merely sequentially so 
plays back the PLs #1, #2, and #3 recorded on the 
BD-ROM. On the other hand, the dynamic scenario in 
the update kit switches between playing back the PL for 
Japan (PL #4) and playing back the PL for the U.S.A. 
(PL #2), depending on the value of SPRM (0). 55 
[0204] Thus, the description of the update kit accord- 
ing to the present embodiment is completed. The follow- 
ing describes the playback apparatus according to the 



present embodiment. FIG. 47 shows the internal struc- 
ture of the playback apparatus according to the present 
embodiment. The playback apparatus in the drawing is 
different in that it comprises a dynamic scenario memory 
20, a playback control engine 21 , a DVD-like module 23, 
a Java module 24, a Browser module 25, and a module 
manager 26. 

[0205] The dynamic scenario memory 20 is a memory 
for storing a current dynamic scenario and for being 
used in the processing performed by the DVD-like mod- 
ule 23 to the Browser module 25. The current dynamic 
scenario is a dynamic scenario being the current 
processing target. When no update kit is stored in the 
local HD 12, the dynamic scenario recorded on the 
BD-ROM serves as the current scenario. When an up- 
date kit is recorded in the local HD 12, the dynamic sce- 
nario in the local HD 12 serves as the current scenario. 
[0206] The playback control engine 21 executes func- 
tions such as (i) an Avplayback function, (ii) a play list 
playback function, and (iii) an obtaining/setting function 
of the status of the playback. The AV playback function 
of the playback apparatus includes a group of functions 
that are inherited from DVD players and CD players and 
are for performing kinds of processing according to user 
operations, such as starting a playback "Play", stopping 
a playback "Stop", pausing a playback "Pause On", re- 
leasing a pause "Pause Off", releasing a Still function 
"Still Off", forwarding at a specified speed "Forward Play 
(speed)", rewinding at a specified speed "Backward 
Play (speed)", switching the audios "Audio Change", 
switching the sub-images "Subtitle Change", and 
switching the angles "Angle Change". The PL playback 
function is to interpret a piece of PL information and to 
start and stop playback according to the piece of PL in- 
formation. When executing the PL playback function, 
the playback control engine 21 plays the role of the third 
layer (playback control based on a static scenario) in the 
layer model. The playback control engine 21 . executes 
the AV playback function according to the user opera- 
tions. Also, the playback control engine 21 executes the 
functions (ii) and (iii), in accordance with the function 
calls from the DVD-like module 23 to the Browser mod- 
ule 25. More specifically, the playback control engine 21 
executes its functions according to instructions in user 
operations and instructions from upper layers in the 
layermodel. 

[0207] The DVD-like module 23 is a DVD virtual play- 
er that serves as the executing subject of the Movie 
mode. The DVD-like module 23 executes a current Mov- 
ie object having been read into the dynamic scenario 
memory 20. 

[0208] The Java module 24 is a Java platform and is 
made up of a Java virtual machine, a configuration, and 
a profile. The Java module 24 generates a current Java 
object from ZZZ. CLASS having been read into the dy- 
namic scenario memory 20 and executes the generated 
Java object. The Java virtual machine converts the Java 
object written in a Java language into native codes for 
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the CPU of the playback apparatus so that the CPU ex- 
ecutes the native codes. 

[0209] The Browser module 25 is a browser that 
serves as the executing subject of the Browser mode. 
The Browser module 25 executes a current WebPage 
object having been read into the dynamic scenario 
memory 20. 

[021 0] The module manager 26 performs mode man- 
agement and branching control. The mode manage- 
ment performed by the module manager 26 is to assign 
one of the modules among the DVD-like module 23 to 
the Browser module 25 to be a module that executes 
the dynamic scenario. The principle used in the assign- 
ment of modules is to have a dynamic scenario execut- 
ed by the DVD-like module 23. This principle is kept 
even if an intra-mode branching (a branching within one 
mode) occurs. An exception is made when an inter- 
mode branching (a branching between modes) occurs. 
When a branching from a Movie object to a Java object 
/ a WebPage object, the Java module 24 or the Browser 
module 25 executes the current object. 
[0211] The branching control performed by the mod- 
ule manager 26 is to specify a dynamic scenario being 
the branching destination, to read the dynamic scenario 
into the memory, and to have the dynamic scenario ex- 
ecuted by one of the DVD-like module 23 to the Browser 
module 25. 

[0212] In the playback apparatus configured as de- 
scribed above, as a result of the DVD-like module 23 to 
the Browser module 25 having the playback control en- 
gine 21 perform a PL playback in accordance with the 
dynamic scenario having been read into the dynamic 
scenario memory 20, the playback as shown in FIGs. 
46A and 46B is achieved. Especially, when the playback 
shown in FIG. 46B is performed, the US-release version 
of the movie production recorded on a BD-ROM can be 
developed into a Japan-release version. 
[021 3] The following describes other examples of var- 
iations in the cases where a newest version of a dynamic 
scenario is downloaded as an update kit. The following 
section discusses an update kit for employing a parental 
lock on a movie production recorded on a BD-ROM. 
[0214] FIG. 48A shows what is recorded on a 
BD-ROM. What is recorded on the BD-ROM are PL #1 , 
PL #2, and PL #3. The PL #2 includes sexual or violent 
scenes and requires an age limit for viewers, the age 
limit being represented by, for example, PG-18. 
[0215] FIG. 48B is an update kit for the BD-ROM 
shown in FIG. 48A. PL #4 included in the update kit is 
an additional PL. The PL #4 is a PL for displaying a menu 
and receiving a user selection from the user. This menu 
is to receive, from the user, a selection of either viewing 
by a child or viewing by an adult. The result of the se- 
lection is set in SPRM (13). In the PL #4, images that 
have a similar substance as the PL #2 are expressed in 
a cartoon-like manner to suit for viewing by children. 
[0216] The replacement dynamic scenario (a Java 
object) plays back the PL #4, before playing back three 



PLs such as the PL #1, PL #2, and PL #3, and after a 
user selection is made, switches between the playback 
of PL #4 and the playback of PL #2 according to the user 
selection. The PL #4 is for receiving a setting for the 

5 parental level (SPRM (13)) in the playback apparatus. 
In the case where SPRM (13) is set as "Adult Only" (if 
(SPRM (13)== Adult Only)), the PL #2 is played back 
(Link(PL#2, Cell #1 )). If the parental level in the playback 
apparatus is set as something else (else), the PL #5 is 

10 played back (Link (PL #5, Cell #1)). Since switching is 
achieved between playback of violent scenes and play- 
back of scenes suitable for children depending on the 
setting in SPRM (1 3), even if a movie production distrib- 
uted on a BD-ROM includes some violent scenes, it is 

'5 possible to add a parental lock to the BD-ROM in a ret- 
rofitting manner. 

[0217] FIGs. 49A and 49B schematically show the 
playback procedures realized with a dynamic scenario 
recorded on a BD-ROM and a dynamic scenario includ- 

20 ed in an update kit. The arrows pel and pc 2 in the draw- 
ing symbolically shows a conditional playback with a dy- 
namic scenario in the update kit. As apparent from the 
drawing, switching between playing back the PL #2 and 
playing back the PL #5 is achieved depending on the 

25 value of SPRM (13). Since the control over whether the 
PL #2 is to be played back or the PL #2 is to be bypassed 
and avoided is performed depending on the value of 
SPRM (13), even if the program recorded on the 
BD-ROM has no function of bypassing the PL #2, it is 

30 possible to realize the playback control of bypassing the 
PL #2 in a retrofitting manner with the use of the dynamic 
scenario distributed from a web site. 
[0218] The following section discusses an update kit 
for developing a theater-release version of a movie pro- 

35 duction recorded on a BD-ROM into a director's cut ver- 
sion. 

[0219] In a theater-release version of a movie produc- 
tion, some scenes have been cut and edited, so that the 
running time is not longer than a little. over two hours. 

40 The running time is usually a little over two hours so that 
the number of times a movie is shown at a movie theater 
in a day can be increased. In other words, due to some 
circumstances that have nothing to do with the movie 
director's intention, editing/cutting is involved in a theat- 

45 er-release version of a movie production. 

[0220] On the other hand, in a director's cut version 
of a movie production, unreleased scenes and some 
scenes that have been cut in the editing process are 
added to the theater-release version. The ideas and 

50 emotions of the movie director's intention are represent- 
ed in a director's cut version. 

[0221 ] FIGs. 50A and 50B show an update kit for de- 
veloping a theater-release version of edited images re- 
corded on a BD-ROM into a director's cut version. FIG. 
55 50A shows the PL #1 , the PL #2, a dynamic scenario (a 
Java object) that are recorded on a BD-ROM. FIG. 50B 
shows an update kit. The update kit includes an addi- 
tional PL #3 and a replacement dynamic scenario. 
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[0222] In the case where a playback order (PL #1 , PL 
2) shown in FIG. 51 A is defined by a dynamic scenario 
recorded on the BD-ROM, the replacement dynamic 
scenario (a Java object) inserts the PL #3, which forms 
an unreleased scene, between the PL #1 and the PL #2. 
FIG. 51 B shows the playback procedure with a replace- 
ment dynamic scenario. Because of the dynamic sce- 
nario, the PLs are played back in the order of the PL #1 , 
the PL #3, and then the PL #2. 
[0223] As explained above, according to the present 
embodiment, by downloading, onto the playback appa- 
ratus, a dynamic scenario for branching depending on 
the status setting of the playback apparatus as a dynam- 
ic scenario for updating, it is possible to enable the user 
to view a version of a movie production that does not 
exist on the BD-ROM. 

[0224] Further, according to the present embodiment, 
it is possible to realize an action that is equivalent to an 
upgrade to a higher version provided after a movie pro- 
duction is distributed on a ROM disc. Like upgrades of 
personal computer software after distribution, movie 
productions distributed on optical discs are also able to 
have upgrades; therefore, the burdens on creators of 
movie productions are lessened. Here, an upgrade of a 
piece of computer software is realized through installing 
a piece of software recorded on a ROM disc onto a per- 
sonal computer and downloading a new update kit to be 
added to the HD. The upgrade of the movie production 
is different from the upgrade of the piece of computer 
software in that the playback apparatus does not install 
the upgrade onto the HD. since the upgrade is not in- 
stalled onto the HD, it is possible to avoid the situation 
where the installment onto the HD becomes a beginning 
of endless duplicates. 

SIXTH EMBODIMENT 

[0225] The sixth embodiment is related to an improve- 
ment for realizing version control of virtual packages. 
FIG. 52 shows a directory structure of an HD according 
to the sixth embodiment. As shown in the drawing, the 
HD has a Vpackage directory below the ROOT directory 
and has abc directory and XYZ directory below the 
Vpackage directory. 

[0226] "Vpackage" in the drawing is a directory that is 
positioned above a directory in which an update kit for 
a BD-ROM is stored. Since the directory storing the up- 
date kit for the BD-ROM is positioned subordinate to the 
Vpackage directory, the directory storing the update kit 
is distinct from other directories in which other files are 
stored. When a BD-ROM is loaded, the control unit 16 
is able to check whether or not an update kit exists by 
checking whether a directory named Vpackage exists. 
[0227] In the drawing, "XYZ" and "abc" are each a vol- 
ume label of a BD-ROM. It means that in the local HD 
12 exist directories that correspond to a BD-ROM hav- 
ing a volume label named "XYZ" and a BD-ROM having 
a volume label named "abc". The sub-directories "Ver- 



sion T and "Version 3" that are positioned subordinate 
to the directory "XYZ" indicate the locations of update 
kits for updating the BD-ROM having the volume label 
"XYZ" into Version 2 and into Version 3. By arranging a 

5 sub-directory below a directory corresponding to each 
BD-ROM, it is possible to separately store update kits 
for different versions of a BD-ROM. 
[0228] Thus, the description of the improvement on 
the local HD 1 2 according to the present embodiment is 

10 completed. The following describes the improvements 
on the constituent elements (the download unit 11 and 
the module manger 26) of the playback apparatus 200, 
the improvements being related to the directory struc- 
ture of the local HD 12. 

15 [0229] When downloading an update kit from the 
WWW server 500, the download unit 11 generates a 
new directory that corresponds to the BD-ROM in the 
local HD 12 and gives the directory a name that is the 
same as the volume label of the BD-ROM. In the case 

20 where a directory corresponding to the BD-ROM exists 
in the local HD 12, a new sub-directory is generated 
within the directory that corresponds to the individual 
BD-ROM. The new sub-directory has a directory name 
that corresponds to a new version of what is recorded 

25 on the BD-ROM. The update kit downloaded from the 
WWW server 500 is written into the new sub-directory. 
For example, in the case where an update kit that should 
be stored into the directory "XYZ" is for the second ver- 
sion, a sub-directory whose directory name is "Version 

30 2" is generated below the directory "XYZ". In the case 
where an update kit is for the third version, a sub-direc- 
tory whose directory name is "Version 3" is generated 
below the directory "XYZ". Subsequently, the download 
unit 11 accesses the WWW server 500, downloads an 

35 update kit, and writes the downloaded update kit into a 
sub-directory for the corresponding version. 
[0230] When a BD-ROM has been loaded onto the 
playback apparatus 200, the module manager. .26 reads 
a volume label from the BD-ROM and specifies, out of 

40 a plurality of directories in the local HD 12, a directory 
that matches the read volume label. Then, the module 
manager 26 checks whether or not sub-directories exist 
below the specified directory. If sub-directories exist, the 
module manager 26 refers to the directory names of the 

45 sub-directories, accesses to a sub-directory of which the 
version number incorporated into the directory name is 
the newest, and reads the update kit from the sub-direc- 
tory. Thus, the description of the improvements on the 
constituent elements related to the directory structure 

so according to the present embodiment is completed. 
[0231] As described above, a virtual package consti- 
tuted with update kits that are stored separately for each 
version is unifyingly managed with the use of package 
unification information. The following describes the 

55 package unification information (INFO, BD) for each vir- 
tual package. FIG. 53 shows the internal structure of IN- 
FO. BD. The "INFO. BD" in a BD-ROM package and in 
a virtual package includes an Index Table, general in- 
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formation (General), and a PLList. 
[0232] The Index Table is made up of a plurality of in- 
dexes for a dynamic scenario. The indexes include a 
FirstPlay INDEX and a menu INDEX. The FirstPlay IN- 
DEX specifies a dynamic scenario that the playback ap- 5 
paratus should execute first when a BD-ROM is loaded 
onto the playback apparatus (i. e. a start-up dynamic 
scenario). 

[0233] The menu INDEX specifies a dynamic scenar- 
io that the playback apparatus should execute when the 
•user performs a "menu call". The menus include a Top 
menu, a Title menu, a Chapter menu, an Audio menu, 
and a SubTitle menu. With the use of these INDEXes, 
the processing to be performed when the BD-ROM is 
loaded onto the playback apparatus or when a menu 
call is performed is defined in a BD-ROM package. As 
a result, INFO. BD defines the behavior of the BD-ROM 
package. 

[0234] The following describes the general informa- 
tion (General), and the PLList. 
[0235] The leaders with broken lines gh1 highlight the 
internal structure of the general information "General". 
As shown by these leaders, the general information 
"General" has a "Package Name", a "Package Version", 
a download permission flag "Downloadability", a "URI", 
and an "Expiration Date". 

[0236] The "Package Name" is a name of a package 
that is in common between a BD-ROM package and a 
virtual package. Normally, the title of a movie is used as 
the "Package Name". The package name is used for 
bringing a BD-ROM package and a virtual package in 
correspondence with each other. 
[0237] The "Package Version" expresses a version to 
which INFO. BD belongs as a numerical value. For ex- 
ample, for INFO. BD on the BD-ROM, the package ver- 
sion is set as "Version 1", whereas for INFO. BD in the 
virtual package, the package version is set as "Version 
2" or later. 

[0238] The download permission flag "Downloadabil- 
ity" is a flag that indicates whether there is a possibility 
that an update kit may be provided in the future. In the 
case where the flag of INFO. BD recorded on a BD-ROM 
indicates "Undownloadable", it means that there is no 
possibility that an update kit may be provided. When the 
flag indicates "Downloadable", it means that an update 
kit for upgrading to a higher version may be provided. 
[0239] By setting the downloadability flag so as to in- 
dicate that upgrading to a higher version is impossible, 
the virtual package is prohibited from being played back 
with an update kit. This situation may look like a disad- 
vantage to the people in the business because there is 
no possibility of providing upgrades to higher versions; 
however, when the downloadability flag indicates that 
upgrades are impossible, to play back a combination of 
a BD-ROM with an update kit is prohibited, and it is 
therefore impossible to create a parody of a movie pro- 
duction with abuse of an update kit and defame the cre- 
ator of the movie. In view of being able to avoiding def- 



amation, there is a great advantage in setting the down- 
loadability flag so as to indicate "undownloadable". 
"URI" stands for Unified Resource Identifier, and it indi- 
cates, if there is a possibility that an update kit may be 
provided, a WWW site in the network in which the up- 
date kit exists. The download unit 11 is able to obtain a 
newest version of an update kit by accessing the WWW 
site indicated by the URI. 

[0240] The "Expiration Date" shows the date until 
which the downloaded update kit is valid. The playback 
control engine 21 compares the current date and time 
clocked by the calendar and the clock inside the play- 
back apparatus with this piece of information of the ex- 
piration date and checks if the update kit is valid or is 
past the expiration date. When the current date and time 
is before the expiration date, playback is performed with 
the use of the update kit including INFO.BD. When the 
current date and time is past the expiration date, play- 
back with the use of the update kit including INFO. BD 
is not performed. 

[0241] The following describes the internal structure 
of a "PLList". The leaders with broken lines gh2 highlight 
the internal structure of a "PLList". A PLList includes the 
number of the PlayLists included in the package 
(Number) and pieces of entry information for each Play- 
List (PLEntries #1 - #n). 

[0242] In each of the pieces of playlist entry informa- 
tion "PLEntries", it is possible to make the setting of, for 
each piece of PL information, information such as 
"Package Version" , "Storage Name", "playList Name", 
and alternative PL information "Alternative".. 
[0243] The "Package Version" expresses a version to 
which the piece of PL information corresponding to the 
PL Entry belongs, as a numerical value. For example, 
for a piece of PL information on a BD-ROM, the Package 
Version is set as Version 1 , whereas for a piece of PL 
information in a virtual package, the Package Version is 
set as "Version 2" or later. 

[0244] The "Storage Name" indicates in which one of , 
for example, a BD-ROM, a HD, a semiconductor mem- 
ory card, and a server in the Internet, the piece of PL 
information corresponding to the PLEntry is located. 
Since it is the download unit 1 1 that positions a piece of 
PL information either in a HD or in a semiconductor 
memory card, the download unit 11 automatically pro- 
vides this information after downloading an update kit. 
[0245] The "PlayList Name" is a serial number for the 
piece of PL information corresponding to the PLEntry, 
and a value such as PL #1 is set. 
[0246] The alternative PL information, "Alternative", 
indicates a playlist that should be alternatively played 
back in case a piece of PL information corresponding to 
the PLEntry is damaged due to a download failure or a 
trouble in the HD. when a piece of PL information is dam- 
aged, it means that it is impossible to properly interpret 
the piece of PL information' due to circumstances such 
as (i) the CELL information constituting the piece of PL 
information fails to specify an AV stream, (ii) the In point 
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and the Out point of the CELL information constituting 
the piece of PL information are improper, and (iii) the 
piece of PL information is already deleted. The alterna- 
tive PL information normally specifies a piece of PL in- 
formation recorded on a BD-ROM. The reason is be- 
cause it is rare that PL information on a BD-ROks gets 
damaged. 

[0247] Thus, the description of INFO. BD for a virtual 
package is completed. The following describes an im- 
provement on a playback apparatus (the download unit 
1 1 , and the module manager 26) related to INFO. BD. 
[0248] The download unit 11 refers to the URI in the 
General information in INFO. BD and downloads an up- 
date kit for an upgrade from the WWW server 500 in the 
network indicated by the URI, and writes the download- 
ed update kit into a directory that corresponds to the in- 
dividual BD-ROM in the local HD 12. The download unit 
11 refers to a calendar inside the playback apparatus 
200 and judges whether or not the current date and time 
has reached the date and time indicated by the "Expi- 
ration Date" in the General information in INFO. BD. If 
the current date and time is before the expiration date, 
the download unit 11 accesses the WWW server 500 
based on the URI in the General information in INFO. 
BD and attempts to perform the download. 
[0249] The playback control engine 21 checks, prior 
to the processing of a piece of PL information, if the 
piece of PL information located at the location indicated 
by the Storage Name in the PLEntry is damaged or not. 
If not damaged, the piece of PL information located at 
the location indicated by the Storage Name in the PL 
Entry is interpreted. If the piece of PL information is dam- 
aged, a piece of PL information indicated by the "Alter- 
native" in the PLEntry is read and interpreted. 
[0250] The module manager 26 plays back a virtual 
package according to the flow chart in FIG. 54. The fol- 
lowing describes the processing procedure performed 
by the module manager 26 according to the present em- 
bodiment, with reference to the flow chart. 
[0251 ] The dynamic scenario i in the flow chart in FIG. 
54 denotes a dynamic scenario i being the target of 
reading from the BD-ROM or from the local HD 12. 
[0252] It is judged whether or not the Downloadability 
flag in INFO. BD on the BD-ROM indicates "undown- 
loadable" (Step S60: YES). After a newest version of 
INFO. BD is read from a subordinate directory in the HD 
(Step S61 ), an initial setting of the dynamic scenario i is 
made (Step S63). 

[0253] In the case where the downloadability flag in 
the INFO.BD indicates "undownloadable", INFO. BD is 
read from the BD-ROM, and control is performed target- 
ing only the BD-ROM. In the case where the download- 
ability flag indicates "undownloadable", it is possible to 
read the dynamic scenario, the PL information, the AV 
stream and the stream management information without 
accessing the local HD 12; therefore, the playback 
processing is performed swiftly. During the initial setting, 
a dynamic scenario that is written in the FirstPlay INDEX 



in the Index Table within INFO. BD is set as the dynamic 
scenario i (step S63). 

[0254] In Step B64, a newest version of the dynamic 
scenario is searched for. In the case where a newest 

5 version of the dynamic scenario i exists in a subordinate 
directory in the HD (Step S64: YES), the newest version 
of the dynamic scenario i is read from the subordinate 
directory in the HD (Step S66). In the case where a new- 
est version does not exist in the subordinate directory, 

10 the dynamic scenario i is read from the BD-ROM (Step 
S65). 

[0255] After the dynamic scenario i is read, each of 
the commands constituting the dynamic scenario i is ex- 
ecuted (Steps S67 through S71). When a command to 
'5 be executed is a branching command, the branching 
destination in the command is set as the dynamic sce- 
nario i (Step S71 ), and the procedure advances to Step 
S64. 

[0256] When a command to be executed is a com- 
20 mand for calling a PlayPL function, PL playback 
processing is performed in Step S72. When the PL is 
played back at this time, it is necessary to search for a 
newest version of the PL information. The following de- 
scribes the procedure of searching for a PL, with refer- 
25 ence to the flow chart in FIG. 55A. The PL to be played 
back in Steps S91 through S95 in the flow chart will be 
referred to as the PL #k. 

[0257] The Storage Name is read from the PLEntry of 
the PL #k in the PLList in INFO. BD. (Step S91). The 

30 playback control engine 21 is instructed to judge wheth- 
er or not what is stored in the storage is damaged (Step 
S92). When what is stored is valid, the piece of PL in- 
formation indicated by the PLEntry of the PL #k is set 
as the PL information #k (Step S93). When what is 

35 stored is invalid, the piece of PL information indicated 
by the Alternative information in the PLEntry of the PL 
#k is set as the PLinformation #k (Step S94). After the 
PL information #k is set in the above process, the PL 
information #k is read (Step S95). 

40 [0258] Thus, the description of the procedure of 
searching for a PL is completed. The following describes 
searching for a newest version of an AV stream speci- 
fied by PL information. 

[0259] FIG. 55B is a flow chart that shows the 
45 processing procedure of searching for a version of an 
AV stream. The processing in Steps S78 through S82 
is to repeat the processing in Steps S80 through S82 for 
each of the Entries in the CELL Information (Steps S78 
and S79). 

50 [0260] The Entries in the CELL information include an 
Audio Entry in an Audio Table, a Subtitle Entry in a Sub- 
Title Table, and an Angle Entry. Among these Entries, 
an Entry being the processing target will be referred to 
as the Entry #p. The processing in Steps S80 through 

55 S82 is a processing for judging a target to read data 
from, i. e. judgment is made as to from which of the HD 
or the BD-ROM, the AV Stream specified by each Entry 
should be read. In Step S80, it is judged whether a new- 



2fi 



51 



EP 1 553 769 A1 



52 



est version of the AV stream specified by the Entry #p 
exists in a subordinate directory in the HD. If the newest 
version exists (Step S80: YES), the newest version of 
AV stream and the stream management information in 
the local HD 1 2 and the AV stream and the stream man- 
agement information on the BD-ROM are set as the 
reading targets (Step S81). If the newest version does 
not exist in the subordinate directory, the AV stream and 
the stream management information on the BD-ROM 
are set as the reading targets (Step S82). By performing 
the processing described in the first, second, or third 
embodiment of the present invention, so as to read the 
reading targets set above, it is possible to selectively 
output one of (a) the audio, the subtitle, and the angle 
recorded on the BD-ROM and (b) the audio, the subtitle, 
and the angle recorded in the local HD 12. 
[0261 ] The following describes the process of reading 
an AV stream, stream management information, and PL 
information in accordance with the processing proce- 
dure described in the flow chart, using specific exam- 
ples. The description in this section is based on an as- 
sumption that there is a directory structure shown in FIG. 
52. 

[0262] In the aforementioned flow chart, in the case 
where files in newer versions than the file recorded on 
the BD-ROM exist in the HD, the newest one of those 
files in the HD is selected and read. FIG. 56 schemati- 
cally shows the process of reading files stored on a 
BD-ROM, in the Version 2 directory, and in the Version 
3 directory. 

[0263] In the drawing, the four boxes with broken lines 
arranged across the page symbolically show the 
BD-ROM, the Version 2 directory, the Version 3 directo- 
ry, and the buffer in the playback apparatus. The white 
bold arrows symbolically show the selections of files be- 
ing selected by the control unit 16 from among the files 
stored on the BD-ROM and in the Version 2 and the Ver- 
sion 3 directories. 

[0264] The arrow nj1 schematically shows reading IN- 
FO. BD in Step S61. In the case where INFO.BD is 
stored on the BD-ROM and in the Version 2 and the Ver- 
sion 3 directories, as a result of the reading process, 
INFO. BD stored in the version 3 directory is read into 
the memory. 

[0265] The arrow nj2 schematically shows reading a 
piece of PL information, "002. PL", in Step S66 . In the 
case where "002.PL" is stored on the BD-ROM and in 
the Version 2 and the Version 3 directories, as a result 
of the reading process, 002. PL stored in the Version 3 
directory is read into the memory. 
[0266] When a file is in a plurality of different versions, 
a selection is made so that the file is taken from a 
direct6ry in the newest version so that AV streams, PL 
information, and dynamic scenarios are supplied; there- 
fore, it is possible to supplement the functions of a pack- 
age released on a BD-ROM, with an update kit down- 
loaded from the WWW server 500. 
[0267] Since it is possible to supplement functions 



that are missing from the BD-ROM or from an update kit 
that has already been distributed, with a newer version 
of update kit, even if a problem arises in the BD-ROM 
or the update kit that has already been distributed, the 
5 distributor is able to correct the errors without recalling 
the products. Since there is no risk of having to recall 
the products, it is possible to eliminate distributors' anx- 
iety experienced when movie productions are distribut- 
ed. 

10 [0268] In the flow charts shown in FIGs. 54 and 55, 
only the newest version of set of INFO. BD, dynamic 
scenario, and PL information is read into the memory; 
however, it is acceptable to sequentially read all the ver- 
sions of sets of INFO. BD, dynamic scenario, and PL 
'5 information into the memory and to generate a virtual 
package in the memory, from a newest version of set of 
INFO. BD, dynamic scenario and PL information, by 
working on a principle that an older version of set of IN- 
FO. BD, dynamic scenario, and PL information is over- 
do written by a newer version of set of INFO. BD. dynamic 
scenario, and PL information. 

SEVENTH EMBODIMENT 

25 [0269] In the sixth embodiment, when a plurality of 
versions of an update kit exist in the local HD 12, a new- 
est version among those is played back. In the seventh 
embodiment, virtual packages in different versions are 
presented to the user so that the user is able to select 

30 a preferred virtual package. 

[0270] Since it is possible to play back different ver- 
sions of virtual packages, the present embodiment has 
an arrangement wherein histories of playback and re- 
cording for each version are kept in the local HD 12, a 

35 server, or a semiconductor memory card. I nf ormation in- 
dicating the histories of playback and recording for each 
version will be referred to as virtual version information. 
A table showing pieces of virtual version information for 
different versions of virtual packages will be referred to 

40 as a virtual package table. 

[0271] FIG. 57 shows the structure of a virtual pack- 
age table. The virtual package table "BD Table" is stored 
in a file "VP INFO", and located in a directory "Vpack- 
age" shown in FIG. 52. The virtual package table in- 

4 5 eludes BD Entries (BDEntries #) and the number of the 
Entries (Number). Each of the BD Entries is the infor- 
mation (virtual package information) for a corresponding 
"INFO. BD". 

[0272] FIG. 58 shows the structure of a virtual pack- 
50 age table for INFO. BDs . The virtual package table is 
structured with "Package Name" of each version, "re- 
cording position information" showing where the update 
kit constituting the virtual package is recorded, and 
"ending position information" showing the playback end- 
55 ing point in an immediately previous playback of the 
package. For example, for the package "ABC", it is 
shown that the recording position of the update kit is the 
"ABC" directory in the local HD, and the ending position 
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of the immediately previous playback of the package is 
at the time point of 3 minutes and 24 seconds in the 
CELL #1 of the PL #2. For the package "XYZ", there is 

no recording position information (shown as " " in the 

drawing). It means that the package is not a virtual pack- 
age, but is an original package recorded on a BD-ROM. 
For the package "WWW", it is shown that the recording 
position is "Memory: ¥WWW" . It means that the record- 
ing position of the update kit is the directory "WWW" in 
a semiconductor memory card. No ending position in- 
formation is provided because the package has not 
been played back yet . 

[0273] For the package "JKF", it is shown that the 
package is recorded in the directory "JKF" in a home 
server. 

[0274] Thus, the description of virtual version informa- 
tion is completed. The following describes improve- 
ments on the playback apparatus side (the download 
unit 1 1 , the playback control engine 21 , and the module 
manager 26) according go the present embodiment. 
[0275] When downloading an update kit from the 
WWW server 500 , the download unit 1 1 sets the record- 
ing position information which shows the writing position 
as virtual version information for the version corre- 
sponding to the update kit. 

[0276] When playback of a PL is finished, the play- 
back control engine 21 generates information indicating 
the playback ending point and sets this information into 
virtual version information for the version corresponding 
to the PL. 

[0277] The module manager26 unifyingly controls the 
playback apparatus 200 in accordance with the flow 
chart in FIG. 59. The following describes the procedure 
of playing back a PL with reference to FIG. 59. 
[0278] When the procedure shown in this flow chart 
starts to be executed, it is judged whether or not a virtual 
package table exists (Step S81), and a list of virtual 
packages is displayed (Step S82). 
[0279] FIG. 60 shows a screen showing the list in Step 
S82. Each of the buttons ("1 : ORIGINAL", "2: VIRTUAL 
PACKAGE 1", and "3: VIRTUAL PACKAGE 2") on the 
screen showing the list visualizes a different one of the 
versions of the virtual packages and changes into a se- 
lected state and a confirmed state according to a user 
operation. The screen showing the list is displayed, and 
the procedure waits until a userselects a virtual package 
(Step S83). After a selection is made, it is judged wheth- 
er or not recording position information for the selected 
virtual package #r exists (Step S84). If recording posi- 
tion information exists, INFO. BD of the version #r is 
read from the storage indicated by the recording position 
information (Step S85), and a dynamic scenario written 
in the FirstPlay INDEX in the INDEX Table for the ver- 
sion tir is set as the dynamic scenario i (Step S86). 
[0280] When no recording position information exists, 
INFO. BD is read from the BD-ROM (Step S87), and a 
dynamic scenario written in the FirstPlaylNDEX in the 
INDEX TABLE in the INFO. BD is set as the dynamic 



scenario i (step S88). At this time, the number of the 
virtual package selected by the user is stored in SPRM 
(24). 

[0281] When the dynamic scenario i has been set in 
5 the process described above, the processing in Steps 
S67 through S73 is performed. During this processing, 
every time the playback control engine 21 plays back a 
PL (Step S72), the eventual playback position is written 
as ending position information in the virtual version in- 
fo formation (Step S89). 

[0282] As explained above, according to the present 
embodiment, when there is a plurality of versions of a 
virtual package, it is managed, for each of the versions, 
how much of the version is viewed by the user; there- 
15 fore, it is possible to prevent the user from experiencing 
confusion caused by the fact that there exist different 
versions at the same time. 

EIGHTH EMBODIMENT 

[0283] In the first embodiment, the update kit is stored 
in the local HD 1 2 in the playback apparatus. The eights 
embodiment is related to an improvement by which an 
update kit can be stored in various places such as in a 
semiconductor memory card, a home server, or the like. 
Since an update kit can be stored in various locations 
such as a semiconductor memory card, or a home serv- 
er, the playback apparatus of the present embodiment 
searches for an update kit with the procedure shown in 
Steps S91 through S96 in FIG. 61, instead of the pro- 
cedure shown in Steps S64 through S66 in FIG. 54 and 
in Steps S80 through S81 in FIG. 55B. 
[0284] Step S8 in the flow chart is for reading an up- 
date kit from the loca 1 HD 12, a server, or a semicon- 
ductor memory card. Step S1 0 is for reading, in the case 
where no update kit exists, PL information, stream man- 
agement information, and AV streams from the 
BD-ROM. 

[0285] In order to search for a newest version, it is 
judged whether or not a local HD 12 is built in the play- 
back apparatus. In the case where an HD is built in (Step 
S91), and virtual package information exists in the local 
HD 12 (Step S92 : YES), an update kit is read in Step 
S97. 

[0286] On the other hand, in the case where no virtual 
package information exists in the local HD 12, but the 
playback apparatus is able to have a connection with a 
server (Step S93), and virtual package information ex- 
ists in the server (Step S9 4), an update kit is read in 
Step S97, also. 

[0287] Finally, in the case where no virtual package 
information exists in the HD 12 and in the home server, 
but the playback apparatus 200 is able to have a con- 
nection with a semiconductor memory card (Step S95), 
and virtual package information exists in the home serv- 
er (Step S96), an update kit is read, also (Step S97). 
[0288] In the case where no local HD 12 is built in, 
and the playback apparatus is not able to have a con- 
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nection with a home server or a semiconductor memory 
card, PL information, stream management information, 
and AV streams are read from the BD-ROM (Step S98). 
[0289] As explained above, according to the present 
embodiment, even if update kits dispersedly exist in var- 
ious devices and media, a necessary update kit is taken 
out from one of the locations; therefore, in order to down- 
load an update kit, there is no need to fix the location at 
which an update kit is located. Accordingly, it is possible 
to more freely determine where an update kit should be 
located. 

[0290] In the present embodiment the processing is 
pursued in the order of the HD, a home server, and a 
semiconductor memory; however, it is possible to 
change the order. For example, it is acceptable to check 
for a server connection first, and a semiconductor mem- 
ory card second, and then, lastly the HD. 

NINTH EMBODIMENT 

[0291] In the first through seventh embodiments, an 
update kit is recorded into the HD. In contrast, the 
present embodiment is related to an improvement for 
writing an update kit into an SD memory card that has 
a secure area and an insecure area. FIG. 62 shows the 
structure of the playback apparatus 200 according to the 
present embodiment. The playback apparatus 200 in 
the drawing is different in that it has a built-in SD memory 
card 30. The playback apparatus of the present embod- 
iment encrypts files constituting an update kit, writes 
them into the unprotected area of the SD memory card 
30, and writes the encryption key into the protected area 
of the SD memory card 30. It is impossible to read the 
encryption key recorded in the protected area unless au- 
thenticity is confirmed through an authentication proc- 
ess with the SD memory card. With this arrangement, it 
is impossible to illegitimately copy the update kit. It is 
possible to read the update kit only when the update kit 
is used along with the BD-ROM. 
[0292] In the case where an update kit is stored in an 
SD memory card, the control unit 1 6 writes the medium 
identification information of the original BD-ROMthat 
corresponds to the update kit into the protected area. 
With this arrangement, it is possible to bring the original 
BD-ROM and the SD memory card in correspondence 
with each other. In addition, when playback is performed 
thereafter, it is checked prior to the playback whether 
the SD memory card and the BD-ROM match each oth- 
er. If they match each other, playback of the movie pro- 
duction is permitted. If they do not match, the playback 
apparatus 200 is prohibited from performing the play- 
back. 

[0293] With this arrangement, when an update kit ex- 
ists, performing playback with only the BD-ROM is pro- 
hibited. That is to say, playback is performed always with 
a combination of the BD-ROM and the update kit. 
[0294] As explained above, according to the present 
embodiment, since an update kit is encrypted and 



stored in an SD memory card along with the encryption 
key, it is possible to restrict illegitimate copies of update 
kits. 

[0295] Additionally, if there arises some trouble with 
5 a BD-ROM package that was distributed in the past, an 
update kit to be sent later will be stored in an SD memory 
card so that playback is performed always with the com- 
bination of the SD memory card and the BD-ROM; 
therefore, it is possible to realize control so that troubles 
10 in the past do not come to the surface. 

SUPPLEMENTARY INFORMATION 

[0296] The invention has been so far described ac- 
15 cording to the embodiments; however, the description 
above merely presents examples of systems that are 
expected to achieve best effects in the present 
situation . The present invention may be embodied in 
modifications as long as it does not deviate from the 
20 main gist thereof. Examples of typical modified embod- 
iments are shown below under (A), (B), (C), and so on. 

(A) PL information may be structured as shown in 
FIG. 63. To be more specific, Clip Entries in the PL 

25 information shown in FIG. 17 specify only AV 
streams recorded on the BD-ROM, while the Audio 
Entry specifies audio in the local HD 1 2 . In contrast, 
the PL information shown in FIG. 63 includes two 
or more Clip Entries so that the second and/or later 

30 Clip Entries specify AV streams in the local HD 12. 

(B) The BD buffer 2, the demultiplexer 3. the video 
decoder 4, the audio decoder 6, the HD buffer 13, 
the demultiplexer 14, and the switch 15 shown in 
FIG. 12 may be structured as shown in FIG. 64A 

35 and FIG. 64B. The buffer 71 and the buffer 72 tem- 
porarily store the ACCESS UNITS outputted from 
the BD buffer 2 and the HD buffer 13. The filter 73 
combines the ACCESS UNITs that are temporarily 
stored in the buffer 71 and the buffer 72 into one 

40 stream. The demultiplexer 3 demultiplexes the 
combined stream so as to obtain a video stream and 
an audio stream and outputs them to the video de- 
coder 4 and the audio decoder 6, respectively. Fur- 
ther, it is acceptable to have a structure as shown 

45 in FIG. 64B. Being separate from the audio decoder 
6, an audio decoder 76 is provided for decoding the 
audio frames outputted from the HD buffer 13. A se- 
lector 75 selectively outputs one of (a) the results 
of decoding performed by the audio decoder 6 and 

50 (b) the results of decoding performed by the audio 
decoder 76. 

The audio decoder 76 performs decoding 
processing by referring to a time obtained by adding 
an offset to a time stamp attached to a TS packet. 

55 With this arrangement wherein the audio decoder 
76 is provided, the audio decoder 6 does not need 
to switch between whether or not the offset should 
be referred to. 
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(C) The arrangement wherein an update kit is pro* 
vided from the WWW server 500 is a mere example. 
It is acceptable to have an arrangement wherein a 
BD-ROM or a DVD on which only an update kit is 
recorded is distributed to users so that the update 5 
kit can be taken from the BD-ROM or the DVD. It is 
also acceptable to have an arrangement wherein 

an update kit is distributed from the WWW server 
500 to a KIOSK terminal so that the KIOSK terminal 
writes the update kit into a semiconductor memory * 0 
card, and the update kit is taken into the playback 
apparatus via the semiconductor memory card. 

(D) It is desirable to download data from the WWW 
server 500 according to a dynamic scenario in a 
Java mode or a Browser mode. A dynamic scenario 15 
in a Java mode or a Browser mode is written in a 
mark-up language such as the Java language, 
HTML, XML, or the like and recorded onto a 
BD-ROM. With this arrangement wherein download 

is performed with such video data, it is possible to 20 
prearrange programming so that an update kit is au- 
tomatically downloaded when a predetermined time 
has arrived. It is also useful to prearrange program- 
ming so that download is performed at regular time 
intervals. It is acceptable to download an update kit 25 
in synchronization with playback of a PL. For exam- 
ple, it is acceptable to prearrange programming so 
that an update kit is downloaded during the play- 
back period of movie trailers recorded on a 
BD-ROM. 30 

(E) It is acceptable to have an arrangement wherein 
some pieces of data that are included only in a U. 
S. distribution version are sold, as update kits, to 
users who reside outside the U.S.A. A movie pro- 
duction to be distributed to a country other than the 35 
U. S. A. needs to have audio and/or subtitles in the 
native language (non-English) of the country multi- 
plexed onto the AV stream. When the AV stream is 
generated, it is necessary to reserve a bandwidth 

for the sub-images and audio. It is often the case 40 
that, in order to reserve such a bandwidth, some 
data for interactive operations which is multiplexed 
onto an AV stream in a U.S. version is deleted from 
the AV stream in a version for other countries be- 
sides the U. S. A. For this reason, in the case where *5 
many users wish to have a U. S. version, distributing 
such data in the U.S. version to users in many other 
countries in the world as update kits makes it pos- 
sible to meet the demands of the users. 

(F) As to directory names, the volume label is used 50 
as medium information of a BD-ROM so that a di- 
rectory corresponding to the BD-ROM is generated 

in the local HD 12; however, it is acceptable to use 
other information as long as the information is re- 
lated to the medium. It is acceptable to use a code 55 
being unique to the BD-ROM, such as medium iden- 
tification information. 

(G) It is acceptable to have an arrangement wherein 



a directory for each individual user is provided be- 
low directories corresponding to BD-ROMs so that 
dynamic scenarios, PL information, AV streams, 
and streammanagement information used by a par- 
ticular user is stored in the directory for the user. 
Further, it is acceptable to have an arrangement 
wherein, when a userplays back a BD-ROM, an AV 
stream is played back with the use of the dynamic 
scenarios, PL information, AV streams, and stream 
management information that are in the directory 
assigned to the user. With this arrangement, it is 
possible to achieve control so that a PL is played 
back without a parental lock for a directory assigned 
to father in a family, while the PL is played back with 
a parental lock for a directory assigned to children 
in the family. 

(H) The AV stream in an update kit according to the 
first embodiment includes only an audio stream for 
a single language, which is audio in the Japanese 
language; however, it is acceptable to have an ar- 
rangement wherein audio streams for a plurality of 
languages such as Japanese, Chinese, and Korean 
languages are recorded as an AV stream. In such 
a case, the update kit includes an AV stream on 
which the plurality of audio streams are multiplexed. 
The AV stream in an update kit according to the sec- 
ond embodiment includes only a sub-image stream 
for a single language, which is a subtitle in the Jap- 
anese language; however, it is acceptable to have 
an arrangement wherein sub-image streams for a 
plurality of languages such as Japanese, Chinese, 
and Korean languages are recorded as an AV 
stream. In such a case, the update kit includes an 
AV stream on which the plurality of sub-image 
streams are multiplexed. 

Further, it is acceptable to have an arrange- 
ment wherein the download unit 11 downloads an 
update kit that includes an AV stream on which a 
sub-image stream and an audio stream are multi- 
plexed. 

(I) The download unit 11 may obtain an update kit 
via FTP through an FTP control connection and an 
FTP data connection as described below. The FTP 
control connection is established between a user PI 
(Protocol Interpreter) within the playback apparatus 
200 and a user P1 (Protocol Interpreter) within the 
WWW server 500, so that an FTP command and an 
FTP reply are transferred. 

The FTP connection is established between a 
user DTP (Data Transfer Process) within the play- 
back apparatus 200 and a user DTP (Data Transfer 
Process) within the WWW server 500, so that the 
update kit is transferred. 

(J) In all of the embodiments, an optical disk to be 
played back by the playback apparatus is imple- 
mented as a BD-ROM, while a recording medium 
on which an update kit is recorded is implemented 
as an HD. However, the characteristics of the play- 
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back apparatus of the present invention are not de- 
pendent on the physical properties of a BD-ROM 
and an HD. Any form of recording media is applica- 
ble as long as it is possible to record anAV stream 
on the recording media. For example, optical disks 5 
such as DVD-ROM, DVD-RAM, DVD-RW, DVD-R, 
DVD+RW, DVD+R, CD-R, CD-RW, and the like, 
and optical-magnetic disks such as PD, MO and the 
like are applicable. Semiconductor memory cards 
such as compact flash cards, Smart Media, Memory 10 
Sticks, MultiMedia Cards, and PCM-CIA Cards and 
the like are also applicable, as are (i) magnetic re- 
cording disks such as flexible disks, SuperDisk, Zip, 
Clik and the like, and (ii) removable hard disk drives 
such as ORB, Jaz, SparQ, SyJet, EZFIyer, micro- ^ 
drive and the like. Furthermore, the recording me- 
dium may also be a built-in hard disk. 
(K) Although the playback apparatuses in all of the 
embodiments output AV streams recorded on a 
BD-ROM to a TV after decoding them, the playback 20 
apparatus may be structured from only a BD-ROM 
drive, and the TV may be equipped with all of the 
other elements. In this case, the playback appara- 
tus and the TV can be incorporated into a home net- 
work connected using IEEE1394. Also, although 25 
the playback apparatuses in the embodiments are 
of a type used after connecting to a television, inte- 
gral dispiay-playback apparatuses are also applica- 
ble. Furthermore, the playback apparatus may be 
only those parts of the playback apparatuses of the 30 
embodiments that perform essential parts of the 
processing. Because these playback apparatuses 
are all inventions disclosed in the specification of 
the present application, acts involving the manufac- 
ture of playback apparatuses based on an internal 35 
structure of the playback apparatuses shown in the 
embodiments are implementations of the inven- 
tions disclosed in the specification of the present 
application. Acts that involve transferring, whether 
onerous or gratuitous, (retail when cost is involved; 40 
a gift when no cost is involved), lending, or importing 
of playback apparatuses shown in the embodi- 
ments are also implementations of the present in- 
vention. Acts that involve approaching the general 
user about transfer, rental or the like by means of *5 
store front displays, catalogue solicitation, pam- 
phlet distribution and the like are also implementa- 
tions of these playback apparatuses. 
(L) Because of the information processing by com- 
puter programs shown in FIGs. 19, 27, 36, 43, 54, so 
55, and 61 being realized specifically using hard- 
ware resources, computer programs showing the 
processing procedures in the flowcharts form an in- 
vention in their own right. Although all of the embod- 
iments show embodiments that relate to the imple- 55 
mentation of computer programs pertaining to the 
present invention in an incorporated form in the 
playback apparatuses, the computer programs 



shown in the embodiments may be implemented in 
their own right, separate from the playback appara- 
tuses. The implementation of the computer pro- 
grams in there own right includes acts that involve: 
(1) production of the programs, (2) transference of 
the programs, either onerous or gratuitous (3) lend- 
ing of the programs, (4) importing of the programs, 
(5) providing the programs for the general public via 
bi-directional electronic communications circuits, 
and (6) approaching the general user about trans- 
fer, rental and the like by means of store front dis- 
plays, catalogue solicitation, pamphlet distribution, 
and so forth. 

(M) The "time" elements of the steps that are exe- 
cuted chronologically in the flow charts shown in 
FIGs . 19, 27, 36, 43 , 54 , 55, and 61 are consid- 
ered to be requisite items with which the present 
invention is identified. Accordingly, it is understood 
that the processing procedures shown in these flow 
charts disclose usages of playback methods. Exe- 
cuting the processing shown in these flow charts by 
chronologically performing the processing in the 
steps so as to achieve the intended objects of the 
present invention and to have the functions and ef- 
fects is implementations of the recording methods 
of the present invention. 

(N) When being recorded on a BD-ROM, it is pref- 
erable that extension headers are provided for TS 
packets constituting an AV stream. The extension 
headers, which are called TP_extra_headers, in- 
clude an "ArrivaLTime_Stamp" and a 
"copy_permission_indicator", and have a 4-byte da- 
ta length. TP_extra_header-attachedTS packets 
(hereinafter, abbreviated to "EX-attached TS pack- 
et") are arranged into groups of 32 packets, and 
written into three sectors. Each group comprising 
32 EX-attached TS packets is 6,144 bytes in length 
(=32 X 192), and matches the 6,144-byte size of 
three sectors (=2048 X 3) . The grouping of 32 EX- 
attached TS packets contained in three sectors is 
referred to as an "Aligned Unit". 

A playback apparatus 200 transmits Aligned 
Units in transmission processing as described be- 
low, when used in a home network connected via 
IEE E1 394 . That is, a device on the side of the send- 
er removes the TP_extra header from each of the 
32 EX-attached TS packets included in an Aligned 
Unit, and outputs the TS packets after encoding the 
TS packet body based on a DTCP standard. When 
outputting TS packets, isochronous packets are in- 
serted at various positions between TS packets. 
The positioning of isochronous packets is based on 
times shown in the ArrivaLTime_Stamp in each 
TP_extra_header. The playback apparatus 200 out- 
puts a DTCP_Descriptor when outputting the TS 
packets. The DTCP_Descriptor shows a copy per- 
missibility setting in each Tp_extra_header. Here, if 
the DTCPJDescriptor is described so as to show 
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"copy prohibited", TS packets will not be recorded 
on other devices when used in a home network con- 
nected vialEEE1394. 

(0) In the case where the playback apparatus 200 
has a recording function onto a recordable optical 5 
disc (such as BD-RE, BD-R, or the like), it is accept- 
able to have an arrangement wherein a virtual pack- 
age being made up of a BD-ROM package in a 
BD-ROM and one or more update kits is converted 
into a BD package, and then written onto a record- 10 
able optical disc. 

In such a case, it is desirable that copying of an 
AV stream is executed based on copy generation 
information (CGI) embedded in the AV stream. 
Copy generation information may indicate "copy '5 
free" which means that the data is free to be dupli- 
cated, "one generation copy" which means that re- 
cording a duplication of one generation is permitted, 
"no more copy" which means that further duplication 
of a duplication is prohibited, or "never copy" which 20 
means that no duplication is permitted. 

In the case where right management informa- 
tion is attached to an AV stream, it is acceptable to 
have an arrangement wherein copying of the AV 
stream is executed under the use conditions de- 25 
fined in the right management information. 

If the right management information defines a 
condition under which copying is permitted with the 
number of times of copying, copying is permitted as 
long as the condition is satisfied. If the right man- 30 
agement information defines a condition under 
which copying is permitted with a validity period 
(year, month, and date are defined), copying is per- 
mitted as long as the condition is satisfied. 
(?) In the case where copying processing has var- 35 
iations such as "move", "migrate", or "check out", it 
is acceptable that copying is executed based on the 
use conditions defined for each of the variations. 
"Move" is a type of copying processing which in- 
cludes deletion of contents of the copy source and 40 
is used when contents are moved between a plu- 
rality of recording media. 

"Migrate" is a type of copying processing based 
on a premise that use condition information is gen- 
erated in the copy destination recording medium. 45 

"Check out" is a type of copying processing in 
which the number of times of copying is limited, and 
contents are copied after the number of times of 
copying is decremented by one. The difference be- 
tween "copying with a limited number of times of so 
copying" and "check out" is that for "check out" , it 
is possible to increment the number of times of cop- 
ying. The number of times of copying is increment- 
ed after a processing (called "check in") is per- 
formed to make it impossible to play back the con- 55 
tents copied and recorded on the recording medi- 
um. 

(Q) The AV streams described in the embodiments 



may be VOBs (Video Objects) complying with a 
DVD-Video standard or a DVD-Video Recording 
standard. VOBs are program streams compliant 
with ISO/IEC13818-1 obtained by multiplexing vid- 
eo and audio streams. Also, in each embodiment, 
AV streams may be referred to as "AV Clips", and 
in which case the stream management information 
may be referred to as "Clip information". In addition, 
video streams in AV streams may be in MPEG-4 for- 
mat, WMV format, or the like. Furthermore, audio 
streams may be in a Linear-PCM format, Dol- 
by-AC3 format, MP3 format, orMPEG-AAC format. 

The CELL information described in the embod- 
iments specifies a starting point and an ending point 
of each playback section using time information; 
however, it is acceptable to specify a starting point 
and an ending point of each playback section using 
logical addresses in a BD-ROM. Further, each 
"CELL" described in the embodiments may be re- 
ferred to as a "Playltem". 

(R) In the layer model shown in FIG. 44, it is accept- 
able to position the Browser mode and the Movie 
mode over the Java mode. The reason for this is 
that executing the Movie mode on the Java mode 
will not cause any problem since, especially, the 
load put on a playback apparatus by interpretation 
of a dynamic scenario in the Movie mode and exe- 
cution of control procedure based on a dynamic 
scenario is light. Another reason is that, in the 
course of development of playback apparatuses 
and movie productions, it would be sufficient to 
guarantee operation in only one mode. 

Further, it is acceptable to execute the process- 
ing in the Java mode with only the Java mode, with- 
out having the three modes. The reason is that it is 
not necessary to have the Movie mode particularly 
since, even in the Java mode, it is possible to have 
playback control in synchronization with playback 
of PLs. Furthermore, control with dynamic scenari- 
os may be only in the Movie mode or only in the 
Browser mode. 

(S) The "TMAP" in the stream management infor- 
mation may be referred to as an "EP_map". In such 
a case, it is desirable to express a playback starting 
time of an ACCESS UNIT with a time stamp (Pres- 
entation Time Stamp) on a piece of picture data po- 
sitioned at the head of the ACCESS UNIT In addi- 
tion, it is desirable to express the address in an AC- 
CESS UNIT as a serial packet number (SPN) of a 
PES packet. 

(T) As for the configuration of the playback appara- 
tus, it is described that only a current dynamic sce- 
nario is stored in the dynamic scenario memory 20 
and that only current stream management informa- 
tion and current PL information are stored in the 
static scenario memory 10; however, it is accepta- 
ble to store in advance, like in a cache memory, a 
plurality of scenarios, pieces of stream manage- 
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ment information, and pieces of PL information. 
With this arrangement, it is possible to shorten the 
time lag that may be experienced before these 
kinds of data are read from a BD-ROM. 
(U) In order to continuously play back two or more 5 
CELLS that constitute a PL, it is desirable to proc- 
ess these CELLS so that these C ELLS are connect- 
ed with one another seamlessly. In order to process 
the CELLS to have seamless connection, duplicate 
portions of an ending portion of a preceding play- 10 
back section and a starting portion of a following 
playback section in video data are generated in ad- 
vance, and these duplicate portions are re-cncod- 
ed. As additional information, it is acceptable to re- 
fer to the duplicate portions generated for the pur- ^ 
pose of seamless connection as Bridge Clips. 

Here, it is desirable to set the ending portion 
and the starting portion in the following manner. 

In the preceding AV stream, ACCESS UNITs 
starting from an ACCESS UNIT that includes the 20 
out point of the preceding playback section and up 
to the second ACCESS UNIT from the ACCESS 
UNIT is set as the ending portion, In the following 
CELL information #x+1 , an ACCESS UNIT that in- 
cludes the In point of the following playback section 25 
is set as the starting portion. The reason why the 
ending portion and the starting portion are set as 
above is described in the publication of the Unites 
States Patent No. 6,148,140 which is the prior art 
by the same applicant. The publication may be re- so 
ferred to for the details. 

Further, it is desirable to prepare seamless con- 
nection information for the duplicate portions gen- 
erated for the purpose of seamless connection. The 
seamless connection information includes the play- 35 
back starting time of the first video frame, the play- 
back ending time of the last video frame, the starting 
time of an audio gap, the time length of the audio 
gap : and the position information of the audio gap. 
By defining such seamless connection information, *o 
it is possible to calculate a difference (STC-Offset) 
between the time stamps of the playback sections 
from the playback starting time of the first video 
frame and the playback ending time of the last video 
frame and set the time stamp difference in the play- 
back apparatus. Further, it is possible to prevent au- 
dio interruption that may occur during a shift from 
one section to another by controlling the audio de- 
coder with reference to the audio gap information. 
(V) The movie productions described in the embod- so 
iments represent all productions that are expressed 
with images, such as television movies and game 
software. The reason for this is that the movie pro- 
ductions described in the embodiments (i) are ex- 
pressed in such a manner so as to cause visual or 55 
audio-visual effects through, for example, displays 
with a cathode ray tube or liquid crystal displays, 
and (ii) exist while maintaining their identity by 



somehow uniting themselves with a corporeal thing 
i.e. a BD-ROM, and (iii) are put in the state where 
they are reproducible; therefore, the requirements 
for existence forms of movie reproductions are sat- 
isfied. 

However, the substantial elements of the 
present invention are not limited to the fact that the 
data represents a movie production; therefore, the 
video data in the present invention may be images 
in a security monitor camera or images in a home- 
use video camera. 

(W) In the embodiments, a user operation is re- 
ceived through a remote controller; however, it is 
acceptable to receive a user operation through a 
front panel of a playback apparatus. It is acceptable 
to receive designation by a user through an input 
device such as a keyboard, a touch panel, a mouse, 
a pad, a track ball, or the like. In such cases, it is 
acceptable to receive user operations represented 
as clicks and drags. 

(X) The movie productions described in the embod- 
iments may be obtained by encoding analog image 
signals broadcasted by analog broadcast. The 
movie productions may be of stream data constitut- 
ed with transport streams broadcasted by digital 
broadcast. 

Contents may be obtained by encoding analog 
/digital image signals recorded on a videotape. Fur- 
ther, contents may be obtained by encoding analog/ 
digital image signals taken directly from a video 
camera. Besides, the present invention is applica- 
ble to digital work distributed from a distribution 
server. 

(Y) The Java module 24 may be a Java platform 
incorporated into a device for the purposes of re- 
ceiving satellite broadcast. In the case where the 
Java module 24 is such a Java platform, the play- 
back apparatus of the present invention also serves 
in the processing by an MHP-oriented STB. 

Further, the Java module 24 may be a Java 
platform incorporated into a device for the purposes 
of controlling the processing of a mobile phone. In 
the case where the Java module 24 is such a Java 
platform, the playback apparatus of the present in- 
vention also serves in the processing by a mobile 
phone. 

Furthermore, the Browser module 25 may be 
browser software that is of a type to be incorporated 
into a personal computer, such as Internet Explorer 
by Microsoft. 

(Z) It should be noted'that it is desirable to transmit 
an update kit with the use of SSL (secure Socket 
Layer). A WWW server 500 being compatible with 
SSL has a digital certificate pre-installed, and trans- 
mits a digital certificate to the playback apparatus 
200 when having received an SSL request from the 
playback apparatus 200. In the digital certificate, a 
public key is encrypted, and the playback apparatus 
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200 authenticates the certificate. As a result of the 
authentication, if a proper public key is obtained, it 
is judged that the WWW server 500 is reliable. 
Then, the playback apparatus 200 transmits a com- 
mon key that is encrypted with the public key. The 5 
WWW server 500 decrypts, with a secret key, the 
encrypted common key having been transmitted 
and shares the common key with the playback ap- 
paratus 200. The update kit is transmitted and re- 
ceived with the use of the common key that is 
shared in this manner. A common key is used for 
the transmission and reception of the update kit so 
that the encryption processing can be performed at 
a high speed. As additional information, HTTP, mail, 
FTP, and Telnet are applicable to the transmission 
and reception of the data. Here, it is also acceptable 
to describe such processing by the playback appa- 
ratus 200 with a dynamic scenario in a Java mode 
or a dynamic scenario in a Browser mode so as to 
supply it onaBD-ROM. 

[0297] It is preferable that accounting settlement for 
distribution of an update kit is performed on a premise 
of having electronic commercial transactions. In such a 
case, merchant software is incorporated into the WWW 
server 500, and wallet software is incorporated into the 
playback apparatus 200, Also, the network shown in 
FIG. 1 is connected to a payment gateway provided at 
a banking institution. Credit card settlements are real- 
ized by using SET (Secure Electronic Transactions) in 
such a network. The playback apparatus 200 transmits 
order information to the server 500 and also transmits 
accounting settlement information to the payment gate- 
way. When having received the order information, the 
server 500 transmits an update kit to the playback ap- 
paratus 200. Since the order information and the ac- 
counting settlement information are transmitted sepa- 
rately, it is possible to enhance the security level of the 
settlement. It is also acceptable to describe such 
processing by the playback apparatus 200 with a dy- 
namic scenario in a Java mode or a dynamic scenario 
in a Browser mode so as to supply it on a BD-ROM. 
[0298] It is acceptable to develop a movie production 
into an on-line game by adding an update kit including 
a dynamic scenario to the movie production recorded 
on a BD-ROM. The dynamic scenario included in an up- 
date kit not only has a PL played back but also obtains 
data from a WEB site and has CG rendered. 
[0299] Such a game has world-wide expansion via the 
Internet unlike a closed space of a BD-ROM and is able 
to have users entertained for a long period to come. 
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3: Demultiplexer 

4: Video Decoder 

5: Picture Plane 

6: Audio Decoder 

7: Image Decoder 

8: Image Plane 

9: Adder 

1 0: Static Scenario memory 

11: Download Unit 

13: HD buffer 

14: Demultiplexer 

15: Switch 

15: Video Plane 

16: Control Unit 

17: Switch 

18: Switch 

19: Streaming Buffer 

20: Dynamic Scenario Memory 

21 : Playback Control Engine 

23: DVD-like Module 

24: Java Module 

25: Browser Module 

26: Module Manager 

30: SD Memory Card 

200: Playback Apparatus 

300: Television 

400: Remote Controller 

500: WWW Server 

600: Home Server 

Industrial Applicability 

[0301] The playback apparatus of the present inven- 
tion performs the playback processing for a virtual pack- 
age in which an update kit is added to what is recorded 
on an optical disc, and effectively enhances the added 
value to the optical disc; therefore, it is possible to sup- 
ply movie discs to markets more intensely, and to ener- 
gize the movie market and the markets for aommercial- 
off-the-shelf devices. Accordingly, the playback appara- 
tus of the present invention has high applicability in mov- 
ie industries and the industries of commercial-off-the- 
shelf devices. 



Claims 

1. A playback apparatus for an optical disc on which 
a first digital stream is recorded, the playback ap- 
paratus comprising: 

a first reading unit operable to read the first dig- 
ital stream, part by part, from the optical disc; 
a control unit operable to specify, from a sec- 
ondary recording medium, a second digital 
stream that is in correspondence with the first 
digital stream; 

a second reading unit operable to read the 
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specified second digital stream, part by part, 
from the secondary recording medium, in ac- 
cordance with control by the control unit; and 
a playback unit operable to play back, in syn- 
chronization, data included in a part read from 5 
the optical disc and data included in a part read 
from the secondary recording medium. 

2. The playback apparatus of Claim 1 , wherein 

the playback unit includes: 1<> 

a first demultiplexer operable to demultiplex the 

part of the first digital stream to obtain pieces 

of video data and pieces of first audio data; 

a second demultiplexer operable to demultiplex 15 

the part of the second digital stream to obtain 

pieces of second audio data; 

a video decoder operable to decode video data; 

an audio decoder; and 

a supplying subunit operable to supply either 20 
the pieces of first audio data or the pieces of 
second audio data to the audio decoder, where- 
in 

the playback unit achieves the playback in 25 
synchronization by, in a case where the pieces of 
second audio data are supplied to the audio decod- 
er, synchronizing the decoding of each piece of sec- 
ond audio data by the audio decoder with the de- 
coding of each piece of video data by the video de- 30 
coder. 

3. The playback apparatus of Claim 2, wherein 

the part of the first di.gital stream and the part 
of the second digital stream are each a packet se- 35 
quence, 

the first demultiplexer performs the demulti- 
plexing at a time indicated by a time stamp on each 
packet, and 

the second demultiplexer performs the de- 40 
multiplexing at a time obtained by adding a prede- 
termined offset to a time indicated by a time stamp 
on each packet. 

4. The playback apparatus of Claim 2, wherein 45 

the part of the first digital stream and the part 
of the second digital stream are each a packet se- 
quence, 

the video decoder decodes each of the pieces 
of video data included in the first digital stream at a 50 
time indicated by a time stamp on a packet in which 
the respective piece of video data is included, and 

the audio decoder decodes each of the pieces 
of second audio data included in the second digital 
stream at a time obtained by adding a predeter- 55 
mined offset to a time indicated by a time stamp on 
a packet in which the respective piece of second 
audio data is included. 



5. The playback apparatus of Claim 4, wherein 

the secondary recording medium stores 
therein stream management information in corre- 
spondence with the second digital stream, the 
stream management information including attribute 
information for the second digital stream and offset 
information, 

the attribute information indicates one of (i) an 
encoding format of, (ii) a channel of, and (iii) a lan- 
guage in correspondence with, the pieces of sec- 
ond audio data included in the second digital 
stream, and 

the offset information indicates each of the off- 
sets to be added to the time indicated by the time 
stamp. 

6. The playback apparatus of Claim 2, comprising a 
system register that stores therein a parameter 
showing a status setting of the playback apparatus, 
wherein 

whether the audio decoder decodes the piec- 
es of first audio data belonging to the first digital 
stream or the pieces of second audio data belong- 
ing to the second digital stream is determined ac- 
cording to the parameter in the system register. 

7. The playback apparatus of Claim 6, wherein 

the control unit displays a menu, and 
the parameter in the system register is updat- 
ed in accordance with a selection from the dis- 
played menu. 

8. The playback apparatus of Claim 6, comprising a 
receiving unit operable to receive a user operation, 
wherein 

the parameter in the system register is updat- 
ed in accordance with the user operation received 
by the receiving unit. 

9. The playback apparatus of Claim 1 , wherein 

the secondary recording medium has playlist 
information recorded thereon, the playlist informa- 
tion showing a starting point and an ending point of 
a playback section in the first digital stream in cor- 
respondence with a starting point and an ending 
point of a playback section in the second digital 
stream, 

the playback apparatus comprises a playback 
control unit operable to interpret the playlist infor- 
mation, and 

the readings by the first and the second read- 
ing units and the playback by the playback uni.t are 
performed based on a result of the interpretation by 
the playback control unit. 

10. The playback apparatus of Claim 9, wherein 

the first digital stream and the second digital 
stream are each made up of a plurality of access 
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units, 

the access units in the first digital stream in- 
clude pieces of video data, the pieces of video data 
each including at least a piece of picture data en- 
coded by intra-frame encoding, 

the part of the first digital stream read by the 
first reading unit is access units in the first digital 
stream, starting from an access unit that includes 
the starting point of the playback section and ending 
with an access unit that includes the ending point 
of the playback section, and 

the part of the second digital stream read by 
the second reading unit is access units in the sec- 
ond digital stream, starting from an access unit that 
includes the starting point of the playback section 
and ending with an access unit that includes the 
ending point of the playback section. 

11. The playback apparatus of Claim 10, wherein 

the optical disc has map information recorded 
thereon, the map information showing a playback 
starting time of each access unit in correspondence 
with an address of the respective access unit, and 

the control unit obtains, by referring to the 
map information, addresses of the access unit that 
includes the starting point and the access unit that 
includes the ending point. 

12. The playback apparatus of Claim 10, wherein 

the access units making up the second digital 
stream are equal in number to the access units 
making up the first digital stream, and 

a playback time period of the access units 
making up the second digital stream is equal to a 
playback time period of the access units making up 
the first digital stream. 

13. The playback apparatus of claim 9, comprising a 
memory, wherein 

the control unit judges whether or not a new- 
est version of the playlist information is recorded on 
the secondary recording medium, and in a case 
where the judgment is in the affirmative, the control 
unit controls the secondary recording medium so 
that the newest version of the playlist information is 
read from the secondary recording medium into the 
memory, and 

the interpretation of the playlist information by 
the playback control unit is to interpret the newest 
version of the playlist information read into the 
memory. 

14. The playback apparatus of Claim 9, wherein 

the secondary recording medium has a plu- 
rality of package areas each of which corresponds 
to a different one of a plurality of optical discs to be 
mounted to the playback apparatus, 

in each of the package areas, package man- 



agement information that includes storage informa- 
tion is recorded, and 

the playback control unit takes out the playlist 
information from a location within the package are- 
5 as being indicated by the storage information, so as 
to interpret the playlist information. 

15. The playback apparatus of Claim 9, wherein 
the package management information further 

includes alternative information, 

the playback control unit checks, prior to the 
interpretation of the playlist information, if the play- 
list information is damaged, and 

in a case where the playlist information is 
damaged, the playback control unit interprets play- 
list information indicated by the alternative informa- 
tion. 

16. The playback apparatus of Claim 9, wherein 
the secondary recording medium has a pro- 
gram recorded thereon, the program showing a pro- 
cedure for playback control of the first and the sec- 
ond digital streams using the playlist information, 

the playback apparatus comprises an execu- 
tion module for executing the program recorded on 
the secondary recording medium, and 

the playback control unit interprets the playlist 
information based on a function call within the pro- 
gram. 

17. The playback apparatus of Claim 16, wherein 
the playback control is to perform the play- 
back using the playlist information under a condi- 
tion, and 

the condition is defined by a system parame- 
ter which is a value stored in a register in the play- 
back apparatus and shows a status setting of the 
playback apparatus. 

18. The playback apparatus of Claim 16, wherein 
the playback apparatus judges whether or not 

the secondary recording medium has a newest ver- 
sion of the program recorded thereon, and 

the execution module executes the program 
in a case where the newest version of the program 
is recorded on the secondary recording medium. 

19. The playback apparatus of Claim 1 , comprising: 

a first buffer for storing the part of the first digital 
stream read from the optical disc; and 
a second buffer for storing the part of the sec- 
ond digital stream read from the secondary re- 
cording medium, wherein 
the playback unit receives the part of the first 
digital stream and the part of the second digital 
stream being supplied via the first buffer and 
the second buffer. 
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20. The playback apparatus of Claim 1, wherein 

the secondary recording medium has a plu- 
rality of package areas each of which is assigned 
to a different one of a plurality of optical discs to be 
mounted to the playback apparatus, 5 

when an optical disc is mounted to the play- 
back apparatus, the control unit controls the first 
reading unit sothat medium information is read from 
the mounted optical disc and specifies, out of the 
plurality of package areas in the secondary record- 
ing medium, a package area that corresponds to the 
read medium information, and 

the second digital stream read by the second 
reading unit exists in the specified package area. 

21. The playback apparatus of Claim 20, comprising a 
memory, wherein 

the optical disc has playlist information, a pro- 
gram, and package management information re- 
corded thereon, 

the playlist information shows a starting point 
and an ending point of a playback section in the first 
digital stream in correspondence with a starting 
point and an ending point of a playback section in 
the second digital stream, 

the program shows a procedure for playback 
control of the first and the second digital streams 
using the playlist information, 

the package management information is 
management information for the first digital stream, 
the second digital stream, the playlist information, 
and the program, 

the control unit controls the second reading 
unit so that any of the playlist information, the pro- 
gram, and the package management information 
that exists within the package area is read from the 
package area into the memory, and 

the control unit controls the first reading unit 
so that any of the playlist information, the program, 
and the package management information that 
does not exist in the package area is read from the 
optical disc into the memory. 

22. The playback apparatus of Claim 21 , wherein 

in a case where the playlist information or the 
program having an identification number in com- 
mon is recorded both on the optical disc and in the 
package area, the control unit controls the second 
reading unit so that the playlist information or the 
program recorded in the package area is read into 
the memory, and 

in a case where the playlist information or the 
program having an identification number is record- 
ed only on the optical disc, the control unit controls 
the first reading unit so that the playlist information 
or the program recorded on the optical disc is read 
into the memory. 



23. The playback apparatus of Claim 22, wherein 

the control unit controls the readings of the 
first and the second digital streams by making the 
first and the second reading units read digital 
streams having identification information in com- 
mon, among a plurality of digital streams recorded 
on the optical disc and in the package area, and 

in a case where a digital stream having an 
identification number is recorded only on the optical 
disc, the control unit controls the first reading unit 
so that the digital stream recorded on the optical 
disc is read. 

24. The playback apparatus of Claim 20, wherein 

inside each of the package areas are two or 
more version areas that correspond to two or more 
versions of what is recorded on the optical disc, re- 
spectively, 

the control unit specif ies, out of the two or 
more version areas within the specified package ar- 
ea, a version area that corresponds to a desired ver- 
sion, and 

the second digital stream read by the second 
reading unit exists in the specified version area. 

25. The playback apparatus of Claim 24, wherein 

each of the version areas has a version 
number that shows a version to which the version 
area corresponds, and 

the control unit specifies the version area by 
specifying, out of the two or more version areas 
within the specified package area, a version area 
that has a newest version number 

26. The playback apparatus of Claim 24, wherein 

the control unit displays a list of a plurality of 
versions of a package and receives a user opera- 
tion for selecting one of the versions of the package, 
and 

the control unit specifies the version area by 
specifying, out of the two or more version areas 
within the specified package area, a version area 
that corresponds to the version of the package se- 
lected by the user operation. 

27. The playback apparatus of Claim 24, comprising a 
memory, wherein 

the optical disc has playlist information, a pro- 
gram, and package management information re- 
corded thereon, 

the playlist information shows a starting point 
and an ending point of a playback section in the first 
digital stream in correspondence with a starting 
point and an ending point of a playback section in 
the second digital stream, 

the program shows a procedure for playback 
control of the first and the second digital streams 
using the playlist information, 
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the package management information is 
management information for the first digital stream, 
the second digital stream, the playlist information, 
and the program, 

the control unit controls the second reading 
unit so that any of the playlist information, the pro- 
gram, and the package management information 
that exists within the specified version area is read 
from the specified version area into the memory, 

the control unit controls the second reading 
unit so that any of the playlist information, the pro- 
gram, and the package management information 
that does not exist in the specified version area is 
read from a version area being in an older version 
than the specified version area into the memory, 
and 

the control unit controls the first reading unit 
so that any of the playlist information, the program, 
and the package management information that 
does not exist in any version area is read from the 
optical disc into the memory. 

28. The playback apparatus of Claim 27, wherein 

in a case where the playlist information or the 
program having an identification number in com- 
mon is recorded both on the optical disc and in the 
plurality of version areas, the control unit controls 
the second reading unit so that the playlist informa- 
tion or the program recorded in the specified version 
area is read into the memory, 

in a case where the playlist information or the 
program having an identification number is record- 
ed only on the optical disc, the control unit controls 
the first reading unit so that the playlist information 
or the program recorded on the optical disc is read 
into the memory, and 

in a case where the playlist information or the 
program having an identification number is record- 
ed only in a version area that corresponds to an old- 
er version than the specified version area, the con- 
trol unit controls the second reading unit so that the 
playlist information or the program recorded in the 
older version area is read into the memory. 

29. The playback apparatus of Claim 28, wherein 

the control unit controls the readings of the 
first and the second digital streams by making the 
first and the second reading units read digital 
streams having identification information in com- 
mon, among a plurality of digital streams recorded 
on the optical disc and in the specified version area, 

in a case where a digital stream having an 
identification number is recoded only on the optical 
disc, the control unit controls the first reading unit 
so that the digital stream recorded on the optical 
disc is read, and 

in a case where a digital stream having an 
identification number is recorded only in a version 



area being in an older version than the specified 
version area, the control unit controls the second 
reading unit so that the digital stream recorded in 
the older version area is read. 

5 

30. The playback apparatus of claim 20, wherein 

each of the package areas has package gen- 
eral information recorded therein, the package gen- 
eral information including a network address, 

10 the playback apparatus comprises a down- 

load unit operable to download an update kit for up- 
grading versions from a server indicated by the net- 
work address in the package general information 
and write the downloaded update kit into one of the 

'5 package areas in the secondary recording medium, 
and 

the second digital stream is included in the up- 
date kit. 

20 31. The playback apparatus of Claim 30, wherein 

the package general information includes 
date and time information, and 

in a case where a current date and time is 
within a period indicated by the date and time infor- 
ms mation, the control unit controls the second reading 
unit so that the second digital stream included in the 
update kit is read, and 

in a case where the current date and time is 
past the period indicated by the date and time infor- 
30 mation, the control unit does not have the second 
digital stream read. 

32. The playback apparatus of Claim 30, wherein 

the package general information includes a 
35 flag that indicates whether or not there is a possi- 
bility an update kit for updating to a new version is 
supplied, and 

the download unit performs the download in 
a case where the flag indicates that there is the pos- 
40 sibility of the update kit being supplied. 

33. The playback apparatus of Claim 1 , wherein 

when downloading the update kit, the down- 
load unit generates, on the secondary recording 
45 medium, a new package area that corresponds to 
the optical disc, assigns identification information to 
the new package area, and writes the update kit into 
the new package area, 

the identification information matches medi- 
50 urn information attached to the optical disc, and 

the second digital stream read by the second 
reading unit is within the update kit written into the 
new package area by the download unit. 

55 34. The playback apparatus of Claim 33, wherein 

in a case where a package area that corre- 
sponds to the optical disc exists in the secondary 
recording medium, the download unit generates a 
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new version area within the package area, the new 
version area corresponding to a new version of 
what is recorded in the optical disc, 

the download unit writes the downloaded up- 
date kit into the new version area, and 

the second digital stream read by the second 
reading unit is within the update kit written into the 
new version area by the download unit. 

35. The playback apparatus of Claim 34, wherein 

in each of the package areas, a plurality of 
pieces of version management information are re- 
corded, the plurality of pieces of version manage- 
ment information being management information 
for versions of what is recorded on the optical disc, 
and 

when having written the downloaded update 
kit into a version area, the download unit sets re- 
cording position information indicating a position at 
which the update kit is written into a piece of version 
management information for a version correspond- 
ing to the update kit. 

36. The playback apparatus of Claim 34, wherein 

the package area that corresponds to the op- 
tical disc exists in the secondary recording medium, 

a plurality of pieces of version management 
information are recorded in the package area, the 
plurality of pieces of version management informa- 
tion being management information for versions of 
what is recorded on the optical disc, 

the second digital stream belongs to one of 
the versions of what is recorded on the optical disc, 
and 

when having finished playing back the first 
and the second digital streams, the playback unit 
generates a piece of information that indicates a 
playback ending point and sets the piece of infor- 
mation into a piece of version management infor- 
mation for a version to which the second digital 
stream belongs. 

37. The playback apparatus of Claim 1 , wherein 

the playback unit includes: 

a first demultiplexer operable to demultiplex the 
part of the first digital stream to obtain pieces 
of video data and first sub-image units; 
a second demultiplexer operable to demultiplex 
the part of the second digital stream to obtain 
second sub-image units; 
a video decoder operable to decode video data; 
an image decoder; and 

a supplying subunit operable to supply either 
the first sub-image units or the second sub-im- 
age units to the image decoder, wherein 

the playback unit achieves the playback in 



synchronization by, in a case where the second sub- 
image units are supplied to the image decoder, syn- 
chronizing the decoding of each second sub-image 
unit by the image decoder with the decoding of each 
5 piece of video data by the video decoder. 

38. The playback apparatus of Claim 37, wherein 

the part of the first digital stream and the part 
of the second digital stream are each a packet se- 
10 quence, 

the first demultiplexer performs the demulti- 
plexing at a time indicated by a time stamp on each 
packet, and 

the second demultiplexer performs the de- 
15 multiplexing at a time obtained by adding a prede- 
termined offset to a time indicated by a time stamp 
on each packet. 

39. The playback apparatus of Claim 37, wherein 

20 the part of the first digital stream and the part 

of the second digital stream are each a packet se- 
quence, 

the video decoder decodes each of the pieces 
of video data included in the first digital stream at a 

25 time indicated by a time stamp on a packet in which 
the respective piece of video data is included, and 
the image decoder decodes each of the sec- 
ond sub-image units included in the second digital 
stream at a time obtained by adding a predeter- 

30 mined offset to a time indicated by a time stamp on 
a packet in which the respective second sub-image 
unit is included. 

40. The playback apparatus of Claim 1 , wherein 

35 the part of the first digital stream on the optical 

disc includes one or more pieces of first video data 
that are taken from one or more angles, 

the part of the second digital stream on the 
secondary recording medium includes one or more 
40 pieces of second video data that are taken from an- 
other angle, and 

the playback unit includes: 

a first demultiplexer operable to demultiplex the 
45 part of the first digital stream to obtain the piec- 

es of first video data; 

a second demultiplexer operable to demultiplex 
the part of the second digital stream to obtain 
the pieces of second video data; 
50 a video decoder operable to decode video data; 

a supplying subunit operable to supply either 
the pieces of first video data or the pieces of 
second video data to the video decoder, where- 
in 

55 

the playback unit achieves the playback in 
synchronization by, in a case where the pieces of 
second video data are supplied to the video decod- 
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er, synchronizing the decoding of each piece of sec- 
ond video data by the video decoder with the de- 
coding of the each piece of first-video data. 

41. The playback apparatus of Claim 40, wherein 

the part of the first digital stream and the part 
of the second digital stream are each a packet se- 
quence, 

the first demultiplexer performs the demulti- 
plexing at a time indicated by a time stamp on each 
packet, and 

the second demultiplexer performs the de- 
multiplexing at a time obtained by adding a prede- 
termined offset to a time indicated by a time stamp 
on each packet. 

42. The playback apparatus of Claim 40, wherein 

the part of the first digital stream and the part 
of the second digital stream are each a packet se- 
quence, 

the video decoder decodes each of the pieces 
of first video data included in the first digital stream 
at a time indicated by a time stamp on a packet, and 

the video decoder decodes each of the pieces 
of second video data included in the second digital 
stream at a time obtained by adding a predeter- 
mined offset to a time indicated by a time stamp on 
a packet. 

43. The playback apparatus of Claim 40, wherein 

the two or more pieces of first video data in- 
cluded in the first digital stream are divided into a 
plurality of portions, 

the plurality of portions are alternately ar- 
ranged and recorded on the optical disc, 

the one or more pieces of second video data 
included in the second digital stream are also divid- 
ed into a plurality of portions and recorded on the 
secondary recording medium, and 

a length of a playback time of the portions that 
make up the second digital stream is equal to a 
length of a playback time of the portions that make 
up the first digital stream. 

44. A playback apparatus for an optical disc on which 
a first digital stream is recorded, the playback ap- 
paratus comprising: 

a secondary recording medium; 
a first reading unit operable to read the first dig- 
ital stream, part by part, from the optical disc; 
a second reading unit operable to read, part by 
part, a second digital stream recorded in a serv- 
er; 

a control unit operable to control the first read- 
ing unit and the second reading unit so that the 
reading from the secondary recording medium 
is performed in parallel with the reading from 



the optical disc; and 

a playback unit operable to take out and play 
back necessary pieces of data from the parts 
read from the optical disc and the secondary 
5 recording medium, wherein 

the secondary recording medium has stream 
management information and playlist informa- 
tion recorded thereon, 

the playlist information shows a starting point 
10 and an ending point of a playback section in the 

first digital stream in correspondence with a 
starting point and an ending point of a playback 
section in the second digital stream, 
the stream., management information is man- 
15 agement information for the second digital 

stream, and 

at least one of the stream management infor- 
mation and the playlist information includes ac- 
cess destination information indicating an ad- 
20 dress of the server storing the second digital 

stream. 

45. An optical disc on which a first digital stream and a 
flag are recorded, the flag indicating whether or not 

25 there is a possibility an updated version of what is 
recorded on a recording medium is supplied, 
wherein 

the updated version includes a second digital 
stream and correspondence information which 
so shows the first digital stream on the optical disc in 
correspondence with the second digital stream. 

46. The optical disc of Claim 45, wherein 

the correspondence information is playlist in- 
35 formation which shows a starting point and an end- 
ing point of a playback section in the first digital 
stream in correspondence with a starting point and 
an ending point of a playback section in the second 
digital stream. 

40 

47. The optical disc of Claim 45, wherein 

the optical disc has address information and 
date and time information recorded thereon, the ad- 
dress information showing an address of a location 
45 from which the updated version is obtained and the 
date and time information showing an expiration 
date and time of the updated version, 

playback using second playlist information in- 
cluded in the updated version is performed before 
50 the expiration date and time, and 

playback using the second playlist informa- 
tion included in the updated version is not per- 
formed after the expiration date and time. 

55 48. The optical disc of Claim 45, wherein 

the updated version includes a program 
showing a procedure for playback control using a 
system parameter, the system parameter being a 
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parameter that shows a status setting of a playback 
apparatus. 

49. A recording medium to be used as a secondary to 
an optical disc on which a first digital stream is re- 
corded, wherein 

the recording medium has a second digital 
stream and correspondence information recorded 
thereon, the correspondence information showing 
the second digital stream on the recording medium 
in correspondence with the first digital stream. 

50. The recording medium of Claim 49, wherein 

the correspondence information is playlist in- 
formation which shows a starting point and an end- 
ing point of a playback section in the second digital 
stream in correspondence with a starting point and 
an ending point of a playback section in the first dig- 
ital stream. 

51. The recording medium of Claim 50, further having 
stream management information recorded thereon, 
the stream management information including at- 
tribute information for the second digital stream and 
offset information, and 

the offset information shows a difference be- 
tween a value of a time stamp on the second digital 
stream and a value of a time stamp on the first digital 
stream. 

52. The recording medium of Claim 50, having a plural- 
ity of package areas each of which corresponds to 
a different one of a plurality of optical discs to be 
used with the recording medium, wherein 

the second digital stream and the playlist in- 
formation are positioned in one of the plurality of 
package areas. 

53. The recording medium of Claim 52, wherein 

each of the package areas has general infor- 
mation recorded thereon, the general information 
including address information and date and time in- 
formation, 

the address information shows an address of 
a location from which an updated version is ob- 
tained, and 

the date and time information shows an expi- 
ration date and time of the updated version. 

54. The recording medium of Claim 52, wherein 

each of the package areas has general infor- 
mation recorded thereon, the general information 
including storage information and alternative infor- 
mation, 

the storage information shows in which one of 
a plurality of areas in the recording medium Lhe play 
list information is positioned, and 

the alternative information shows alternative 



playlist information to be used in place of the playlist 
information in a case where a playback apparatus 
judges that the playlist information is damaged. 

5 55. The recording medium of Claim 52, wherein 

inside each of the package areas are two or 
more version areas that correspond to two or more 
versions of what is recorded on the corresponding 
optical disc, and 

10 the second digital stream and the playlist in- 

formation are positioned in one of the package ar- 
eas. 

56. The recording medium of Claim 50, having a pro- 
's gram recorded thereon, the program showing a pro- 
cedure for playback control using the playlist infor- 
mation. 

57. The recording medium of claim 56, wherein 

20 the procedure for playback control is to per- 

form playback using the playlist information under 
a condition, and 

the condition is defined by a system parame- 
ter which shows a status setting of a playback ap- 

25 paratus. 

58. The recording medium of Claim 50, wherein 

the first digital stream includes video data and 
audio data, and 
30 the second digital data includes audio data. 

59. The recording medium of Claim 50, wherein 

the first digital stream includes video data and 
sub-image units, and 
35 the second digital stream includes sub-image 

units. 

60. The receding medium of Claim 50, wherein 

the first digital stream on the optical disc in- 
40 eludes two or more pieces of first video data that 
are taken from two or more angles, and 

the second digital stream on the recording 
medium includes one or more pieces of second vid- 
eo data that are taken from another angle. 

45 

61. The recording medium of Claim 60, wherein 

the two or more pieces of first video data in- 
cluded in the first digital stream are divided into a 
plurality of portions, 
50 the plurality of portions are alternately ar- 

ranged and recorded on the optical disc, 

the one or more pieces of second video data 
included in the second digital stream are also divid- 
ed into a plurality of portions and recorded on the 
55 recording medium, and 

a length of a playback time of the portions of 
the first digital stream is equal to a length of a play- 
back time of the portions of the second digital 
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stream. 

62. The recording medium of Claim 50, wherein 

the first digital stream and the second digital 
stream are each made up of a plurality of access 
units, 

the access units making up the first digital 
stream include pieces of video data, 

the access units making up the second digital 
stream are equal in number to the access units 
making up the first digital stream, and 

a playback time period of the access units 
making up the second digital stream is equal to a 
playback time period of the access units making up 
the first digital stream. 

63. The recording medium of Claim 62, wherein 

the optical disc has map information recorded 
thereon, the map information showing a playback 
starting time of each access unit in correspondence 
with a size of the respective access unit, and 

by referring to the map information, a first 
reading unit obtains addresses, on the optical disc, 
of an access unit that includes the starting point and 
an access unit that includes the ending point. 

64. The recording medium of Claim 62, wherein 

the access units making up the first digital 
stream are equal in number to the access units 
making up the second digital stream, and 

a playback time period of the access units 
making up the second digital stream is equal to a 
playback time period of the access units making up 
the first digital stream. 

65. A playback program for an optical disc, on which a 
first digital stream is recorded, the playback pro- 
gram having a computer execute: 

a first reading step of reading the first digital 
stream, part by part, from the optical disc; 
a control step of specifying, from a secondary 
recording medium, a second digital stream that 
is in correspondence with the first digital 
stream; 

a second reading step of reading the specified 
second digital stream, part by part, from the 
secondary recording medium, in accordance 
with control by the control step; and 
a playback step of playing back, in synchroni- 
zation, data included in a part read from the op- 
tical disc and data included in a part read from 
the secondary recording medium. 

66. A playback method for an optical disc on which a 
first digital stream is recorded, the playback method 
comprising: 



a first reading step of reading the first digital 
stream, part by part, from the optical disc; 
a control step of specifying, from a secondary 
recording medium, a second digital stream that 
5 is in correspondence with the first digital 

stream; 

a second reading step of reading the specified 
second digital stream, part by part, from the 
secondary recording medium, in accordance 
10 with control by the control step; and 

a playback step of playing back, in synchroni- 
zation, data included in a part read from the op- 
tical disc and data included in a part read from 
the secondary recording medium. 
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